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DIETARY ASSESSMENT METHODOLOGY FOR WIC 


EXECUTIVE SUMMARY 


A women’s and a children’s food frequency questionnaire and 
accompanying scoring methods (both manual and computerized) to 
evaluate dietary adequacy were developed for possible use with clients 
in the Special Supplemental Food Program for Women, Infants, and 
Children (WIC). The questionnaires were modifications of a women’s 
questionnaire developed and tested by investigators at Harvard School 
of Public Health. The modifications were based on findings from 
earlier testing of the women’s questionnaire, data from the 1985 1-day 
sample of low-income women and their children in the Continuing 
Survey of Food Intake by Individuals, data from a large sampling of 
State WIC food frequency questionnaires, field observations involving 
WIC clients and staff, literature reviews, and (to the least extent 
possible) constraints imposed by the associated manual scoring method. 
The manual and computerized scoring methods were designed for use 
by both professional and paraprofessional staff. 


The questionnaires were designed to be self-administered by women or 
by caretakers, in the case of children. A primary concern in the design 
of the self-administered questionnaires is ease of use by the clients. The 
women’s and children’s food frequency questionnaires contain the same 
78 food items with four minor exceptions. For each food item, the 
respondent is asked to mark frequency of intake over the past four 
weeks in one of nine boxes representing frequencies ranging from zero 
in four weeks to six or more times daily. 


The manual scoring method is based primarily on the food group 
recommendations as listed in Dietary Guidelines for Americans and 
involves determining whether the number of servings reported meets 
defined minimums for milk products, fruits, vegetables, meats, and 
grains [1]. This is accomplished with the use of four templates and 
identification of food group patterns; however, counting and a small 
amount of arithmetic are required. The criteria for determining 
inadequacy can be changed by requiring that intake fall below the 
minimum number of servings for more or fewer food groups. The 
criteria could also be changed by changing the defined minimums for 
servings from the food groups, but this would require revision of the 


templates and scoring directions. 


The computerized scoring method generates printouts and screen 
displays that report the daily number of servings from the same five 
food groups as well as vitamin A rich foods, vitamin C rich foods, 
sweets, and fats. It also lists the number of servings reported for each 
food item, alerts the user to potential problems in the data collection, 
and produces a graph showing the client’s indexes of nutritional quality 
for the nutrients protein; calcium; iron; zinc; and vitamins A, B-6, C, 
and folate. This computerized analysis uses the 1989 Recommended 
Dietary Allowances for age and physiologic status, and it uses portion 
sizes based mainly on medians reported by comparable populations in 
nationwide surveys [2]. 





Scope of Report 


I. INTRODUCTION 


A. RATIONALE FOR THE STUDY 


The purpose of this project was to develop two food frequency 
questionnaires and accompanying scoring methods, both manual and 
computerized, for possible use with women and with children 1 to 5 
years of age in the Special Supplemental Food Program for Women, 
Infants, and Children (WIC). The Food and Nutrition Service (FNS) 
of the U.S. Department of Agriculture (USDA) administers the WIC 
Program. Specifically, FNS requested that Harvard School of Public 
Health (HSPH) expand and modify a food frequency questionnaire that 
had been developed to screen and classify the diets of pregnant women 
to allow for screening of women (pregnant, breastfeeding, and non- 
breastfeeding postpartum) and children 1 to 5 years of age. The HSPH 
Prenatal Food Frequency Questionnaire (PFFQ) had been developed and 
validated by Carol Jean Suitor with funding under a dissertation grant 
from the National Center for Health Services Research and Health Care 
Technology Assessment and partial funding from a Special Project of 
Regional and National Significance grant from the U.S. Department of 
Health and Human Services [3]. The self-administered PFFQ was to 
serve as the basis for both the women’s and the children’s 
questionnaires. The women’s food frequency questionnaire (WFFQ) 
was to be suitable for use by pregnant, lactating, and postpartum non- 
lactating women and teenagers across the United States. The children’s 
food frequency questionnaire (CFFQ) was to be designed to be 
completed by the mother or other caretaker of a child aged 1 to 5 years. 
Although this document treats the development of the two questionnaires 
and the two types of scoring methods as distinct parts of the project, the 
activities and findings relating to any one part could and often did 
influence decisions made concerning the other instruments. 


This report describes the methods used to develop the instruments, 
presents instructions for their use, provides copies of each instrument, 
provides manual scoring instructions and models of the scoring 
templates, describes the software and templates for computerized 
scoring, compares the results of the two scoring methods, identifies the 
advantages and limitations of the instruments, and proposes 
recommendations for future efforts. In addition to this report, FNS was 
provided the color coded, plastic laminated templates used for manually 
scoring the questionnaires; the software for computerized scoring; and 
the plastic templates for entering data for computerized analyses. 


Project Objectives 


The approach to the project was influenced to some extent by activities 
at USDA. At the time the project began, the WIC program targeted 
energy and the nutrients protein, calcium, iron, and vitamins A and C. 
During the course of the project, Federal Register notices announced 
FNS’s intent to review the targets set for nutrients provided by WIC 
food packages and the content of the packages, thus making it advisable 
for the investigators to consider approaches that might provide 
information about other nutrients (e.g., zinc and folate) as well [4,5]. 
FNS asked the investigators to use the most recent edition of Dietary 
Guidelines for Americans as the basis for scoring [1]. 


In summary, this report describes the methods and outcomes for the 
following objectives: 


1. Revise the self-administered food frequency questionnaire for 
pregnant women (PFFQ) to include lactating and non-lactating 
postpartum women. 


2. Using similar methodology, develop a food frequency questionnaire 
for screening the diets of low-income children 1 to 5 years of age. 


3. Expand the computer software for PFFQ to allow for analysis of the 
dietary data as reported on the questionnaires developed for women 
and children. 


4. Develop a method to manually score the data collected from the 
women’s and children’s food frequency questionnaires. 


B. BACKGROUND INFORMATION 


This work represents one of a series of activities that grew out of a 
1985 U.S. General Accounting Office (GAO) report that stated 
“program resources could be used more effectively if nutritional risk 
criteria were uniform" [6]. That report also indicated that inadequate 
dietary pattern is relatively unreliable as a measure of nutritional risk 
and holds potential for being overused. 


In 1988, the Food and Nutrition Service conducted a survey of State 
WIC agencies to learn about their use of food frequency questionnaires 





and to collect evidence concerning their validity and reliability. The 
completed questionnaires provided a useful source of information for 
this project. 


Also in 1988, the National Association of WIC Directors and FNS 
jointly developed standards of practice for WIC nutrition services. One 
of those standards states that standardized dietary assessment procedures 
based on current practice should be used consistently in all of a State’s 
local agencies. The criteria for meeting that standard are relevant to 
this project and thus are listed below: 


@ The State agency assures that local agencies use a uniform tool. 


@ A food frequency tool is used when dietary risk is the only certifying 
risk criterion for a participant. 


@ Analysis of the diet is based on professionally recognized 
guidelines. 


@ There are specific criteria statewide for evaluating dietary adequacy 
to determine WIC eligibility. 


@ The State agency documents the rationale for dietary adequacy 
standards. 


@ The State agency has standardized procedures for documenting 
dietary risk assessment in the participant’s file. 


@ There is training for local agency staff on collecting, analyzing, and 
documenting the dietary assessment data. 


In 1989, FNS held a two-day Task Force Meeting on Dietary 
Assessment [7]. Among the task force recommendations relevant to this 
project are the following: 


@ The food frequency tools for children should be limited to children 
who are at least one year of age. 


@ The tool should serve several functions: screening for inadequate 
diet, facilitation of the triaging of patients for services, and 


Benefits Provided by 
the WIC Program 


facilitation of general nutrition education. 


@ The tool should be designed in a paper format that could be self- 
administered by clients and manually scored/evaluated. In addition, 
the tool should lend itself to computer application in administration 
and evaluation. 


@ Evaluation of the diet using the tool should take two to five minutes 
by either a paraprofessional or professional. 


© Scoring should reflect the nutrients targeted by the WIC program. 


@ Dietary inadequacy values would be determined by each State and, 
to assist in that determination, any point values used in scoring 
would be defined as to how they correlate with the percentage of the 
Recommended Dietary Allowances for targeted nutrients. 


C. OVERVIEW OF THE WIC PROGRAM’ 


WIC is a grant program administered by FNS of USDA. In 1969, the 
White House Conference on Food, Nutrition, and Health recommended 
that special attention be given to the nutritional needs of pregnant 
women and preschool children. As a result, legislation authorizing WIC 
was passed in 1972 (P.L. 92-43). 


The goal of the WIC Program is to promote the health of program 
participants during pregnancy and the postpartum period, infancy, and 
early childhood by providing nutritious foods and nutrition education as 
adjuncts to good health care. The benefits provided by the WIC 
Program include: 


Supplemental Foods. WIC makes available six food packages that are 
designed for different categories of participants. These packages 
contain foods that are good sources of nutrients most likely to be 


“Much of this overview was provided by FNS in the Cooperative 
Agreement for this project. 





lacking in the WIC population’s diet--protein, iron, calcium, and 
vitamins A and C. The food items provided include iron-fortified infant 
formula and cereal, juice, milk, cheese, eggs, peanut butter, and dry 
beans or peas. These foods are not intended to provide total dietary 
needs but rather to supplement the diets of participants. 


Nutrition Education. The current WIC legislation mandates that the 
equivalent of at least one-sixth of the funds expended by the State 
agency for administrative costs be spent for nutrition education in order 
to assist the individual who is at nutritional risk to achieve positive 
changes in food habits, and consequently to contribute to improved 
nutritional status and the prevention of nutritional-related problems. 


Access to Health Care. Each WIC agency is to operate as an adjunct 
to good health care and, as such, is to encourage and refer participants 
to health care. WIC and the health community work hand in hand to 
promote better health and nutritional status for a vulnerable population. 
The program has undergone rapid expansion since its inception. 
Funding has increased from $20 million in 1974 to a funding level of 
approximately $2.1 billion in Fiscal Year 1990. Participation has 
increased from 205,511 persons in Fiscal Year 1974 to about 4.5 
million persons in Fiscal Year 1990. 


The WIC Program functions administratively at three levels: federal, 
state, and local. FNS, through its seven regional offices, provides cash 
grants to designated WIC State agencies for program administration and 
operations. Regulations governing WIC are promulgated by FNS, and 
FNS Regional Office staff monitor State agencies for compliance to 
these regulations. WIC State agencies are responsible for the 
establishment, monitoring, and reporting of local WIC agency activities 
to FNS. These State agencies allocate funds to participating local WIC 
agencies within their areas. Local agencies are often city or county 
health departments, but also may be any of a variety of public or 
nonprofit health or human service organizations such as hospitals, 
maternal and child health groups, or community action agencies. The 
funds received by local WIC agencies are used to provide specified 
supplemental foods to WIC participants and to pay administrative costs, 
including the costs of certifying applicants for eligibility and providing 
nutrition education and counseling. 


WIC Program at Local 
Agency Level 


To qualify for WIC benefits, an applicant must meet certain eligibility 
requirements: 


Categorical Status. Eligible categories include women during 
pregnancy and for the first 6 weeks after delivery, breastfeeding women 
up to 1 year postpartum, non-breastfeeding postpartum women up to 6 
months postpartum, infants up to 1 year of age, and children ages 1 up 
to 5 years old. 


Income. The income limit is set by each State agency, but cannot 
exceed 185 percent or be less than 100 percent of the U. s. Poverty 
Income Guideline for each family size. 


Nutritional Risk. Applicants who meet the categorical and income 
requirements must be certified by a competent professional authority to 
be at nutritional risk. Screening for nutritional risk includes 
anthropometric measurements, blood tests for anemia, health history and 
dietary assessment. Nutritional risk may be based on medical, clinical, 
and /or dietary risk criteria. 


The level of WIC program operation at the local agency level depends 
on the level of funding that is available. For each local agency, a 
maximum caseload is determined, depending on its assigned annual 
funding level and predicted caseload turnover. When local WIC 
agencies reach this maximum participation level within the available 
funding, a system of priorities is followed in allocating "slots" to 
eligible applicants. Seven priority levels are defined, based on the 
applicant’s categorical status and type of nutritional risk condition, as 
follows: 


1. Pregnant and breastfeeding women and infants at nutritional risk as 
demonstrated by anthropometric or hematological assessment or by 
other documented nutritionally-related medical condition. 


2. Infants up to 6 months of age of mothers who participated in WIC 
during pregnancy, or of mothers who were at nutritional risk during 
pregnancy. 


3. Children at nutritional risk, as demonstrated by anthropometric or 
hematological assessment or other documented nutritionally-related 








medical condition. 


4. Pregnant and lactating women and infants at nutritional risk as 
demonstrated by inadequate dietary pattern. 


5. Children at nutritional risk due to inadequate dietary pattern. 


6. Postpartum women, non-lactating, at nutritional risk based on either 
medical or dietary criteria. 


7. Previously certified participants likely to regress in nutritional status 
without continuation of supplemental foods. 


State agencies have the options of creating sub-priorities within 
priorities and expanding priority levels 2, 4, or 5 to include high-risk 
postpartum women. In general, the thrust of the existing priority 
system for WIC eligibility certification is to give precedence to 
medically-based nutritional risk over risk based on inadequate diet alone 
for all categories of participants. 








Il. LITERATURE REVIEW 


A. FOOD FREQUENCY QUESTIONNAIRES 


The food frequency questionnaire was introduced in 1962 by Trulson 
and Stefanik as a method of assessing the usual intake of specific foods 
in large population studies [8]. Other researchers continued to use and 
to improve the food frequency instrument as a primary tool for dietary 
assessment, citing its advantages to include high response rate, minimal 
burden to respondents, and ease of administration (including by 
nonprofessional staff) [9-14]. 


During the 1980s, studies to refine, test reliability, and validate the food 
frequency questionnaire as a dietary assessment tool were much in 
evidence [15-28], causing them to be referred to as the "dominant theme 
of the decade" in dietary methodology [29]. The method was being 
used not only to assess usual intake, but also to analyze food groups, 
food components, and nutrients [30]. Quantitation of nutrient intakes 
gathered by food frequencies was reported by several studies 
[16,19,31,32], and a carefully conducted validation study over a 1-year 
period indicated that the food frequency questionnaire provided useful 
information related to both group means and individual intakes of 18 
nutrients [31]. Hislop et al. studied misclassification and bias using 
self-administered food frequency questionnaires mailed to 463 persons 
to ask about specific food items across four different age periods [33]. 
The food frequency questionnaire was found to be more reliable for 
specific food items in the distant past than for the more recent past. 
Potosky et al. noted that the estimated validity of a questionnaire is 
higher when compared with three sets of 4-day records rather than just 
one set [34]. Block et al. found that a self-administered diet history 
questionnaire produced group means of nutrient estimates closely 
approximating the values obtained by three 4-day records; correlations 
for most nutrients were 0.5 to 0.6, similar to those achievable by a 
single 4-day record [35]. Block and Hartman indicate that while 
respondent accuracy is the most frequently discussed. factor in poor 
reliability and validity, many other factors which affect reliability and 
validity of dietary assessment questionnaires are under the control of the 
investigator and are thus amenable to improvement [36]. 


Kristal et al. reported the development of an abbreviated method for 
rapid assessment of dietary intake of fat, fiber, saturated fat, and 
percent energy from fat [37]. Results of the short dietary questionnaire 
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administered to 97 women were compared with results from both a food 
frequency questionnaire and the mean of two 4-day diet records. 
Correlations for the nutrients studied between the short questionnaire 
and 4-day records were similar to those between the food frequency and 
4-day records, ranging from 0.40 to 0.61. This suggests that the short 
dietary questionnaire may be useful in situations where more expensive 
and time-consuming methods are not practical. 


Suitor reported the development and testing of a self-administered food 
frequency questionnaire for use with low-income pregnant women [3]. 
The instrument was field tested with 295 participants; a subset of 95 
women also provided three 24-hour recalls for comparative studies. 
Correlation coefficients adjusted for measurement error indicated that 
the questionnaire would correctly identify a high proportion of women 
having low intake of selected nutrients. Additional reports by Suitor 
and colleagues present the use of the food frequency questionnaire with 
low-income, culturally diverse pregnant women to describe supplement 
use [38] and to calculate an index of nutritional quality (INQ) [39]. 


The appropriate determination of food portion sizes to represent intake 
is a continuous concern among investigators. Pao et al. used 3-day 
reports of 38,000 individuals to determine gram weights of foods eaten 
per meal or snack [40]. Using these data to compare with traditional 
or standard servings, Krebs-Smith and Smicklas-Wright determined that 
traditional serving sizes differ from reported serving sizes for many 
foods: fruit juices, breads, and cereals are eaten in larger amounts than 
standard servings while raw vegetables, meats, fish, and poultry vary 
widely [41]. Hunter et al. reported consumption among women of a 
wide range of portion sizes of 68 commonly eaten foods [42]. 


Clapp et al. studied whether the classification of individuals according 
to usual nutrient intake calculated by using a food frequency 
questionnaire with standard versus reported portion sizes was the same 
or different [43]. The authors concluded that replacing reported portion 
sizes with standard portion sizes to measure overall nutrient intake of 
a group may cause underestimations of some nutrients and lead to 
different study results. Mean intakes were lower when standard portion 
size data replaced reported portion size data for all nutrients studied. 
Guthrie studied food choice and quantitation abilities of 147 adults and 
determined poor ability to describe portion sizes without probing or the 








assistance of models [44]. Correct estimates (within 25 percent) were 
made by 8 to 68 percent of respondents; 0 to 67 percent overestimated 
by more than 51 percent and 0 to 25 percent underestimated by more 
than 51 percent. Guthrie stated that this suggests the need to provide 
respondents with help in estimating portion sizes, or to develop methods 
that do not depend on ability to accurately describe portion sizes. 


The ability of WIC participants to estimate portion sizes of 10 
commonly used foods displayed in household portions was studied by 
Webb and Yuhas [45]. A majority of subjects could not give the 
correct amount for any of the displayed foods and most quantities were 
overestimated, causing the investigators to conclude that reporting of 
food intakes may likewise be incorrect, probably overestimated. 
Overestimation of food quantity was also reported from 8 to 9 year old 
boys and their mothers [46]. Lewis et al. investigated cola beverage 
intake in two large national studies and concluded that there was 
underestimation of intake because of larger portion size among more 
frequent users [47]. 


B. DIETARY ASSESSMENT FOR CHILDREN 


Morgan suggested that the admittedly difficult task of obtaining dietary 
records for infants and young children could be improved by 
streamlining methodology and stating objectives more clearly [48]. 
Methodology to determine the dietary intake of school-age children has 
primarily concentrated on the 24-hour recall from the child [49-53]. 
Diet recordings for 3 days [54] and 4 days have also been described 
[55]. 


Some newer techniques for obtaining dietary intake of children have 
been reported recently. A consensus recall, involving reports from both 
parents and the child produced more accurate estimates of the observed 
dietary intake of 34 children (aged 4 to 9.5 years) for one meal on the 
previous day than did recalls from father or mother alone [56]. 


Trieber et al. concurrently administered the 24-hour recall and a 3- 
month food frequency questionnaire on two occasions (1 week apart) to 
parents of 55 preschool children (mean age 4.25 + .59 years) [57]. 
Test-retest reliability estimates for the food frequency were positive for 
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all nutrients for all units of expression. The authors concluded that 
reliable parental estimates can be obtained of preschooler’s intakes over 
a 3-month interval using the food frequency questionnaire. Dietary 
information gathered about younger children must obviously rely on 
adult respondents. Recall data obtained from parents or primary 
caretakers of 30 Caucasian children, aged 24 to 48 months, of middle 
social economic status, correlated highly with weighed food intake [58]. 
Most errors occurred in portion size; 96 percent of specific foods eaten 
by the children were correctly identified. 


Basch et al. assessed the validity of mothers’ recall of dietary intake of 
4 to 7 year old children among first generation Latino immigrant 
families by comparing intake reported by the mother to home 
observations made by trained observers [59]. Correlations were high 
to moderate for calories and most nutrients. At least two-thirds of the 
children were correctly classified into lowest or second lowest (or 
highest) quintiles based on mothers’ reports. More than one-half of 
portion sizes were equivalent to those reported while 33.5 percent were 
larger and 15.5 percent were smaller. There was fair agreement on the 
number of foods eaten. Eck et al. administered a food frequency 
questionnaire at 4-month intervals to 108 families to obtain intake of 
children (mean age 5.2 years) [60]. The one year assessment appeared 
to compare favorably with food frequency measures of children’s intake 
over shorter periods. The mean correlation between 4-month interval 
assessments and the one year retrospective assessment was 0.67. This, 
however, is not an appropriate test of validity as correlated errors no 
doubt have inflated the correlates. 


C. SCORING FOOD FREQUENCY QUESTIONNAIRES 


Guthrie and Scheer used a dietary score based on Basic Four food 
groupings to determine adequacy of intake from 212 24-hour recalls; 
they concluded that the dietary scoring method was similar to a more 
complete and time-consuming dietary analysis of actual intake, and in 
addition, it was simple, quick, and easy-to-use [61]. Kennedy 
developed a nutrient score using a modified food frequency and four 
food groups [62]. The nutrient score had no predictive value in 
identifying women likely to produce low birth weight babies, but the 
author believed it would have been improved if caloric consumption had 














been included. Murphy et al. developed a dietary score from NHANES 
survey data of 3,436 Mexican-American children based on the number 
of servings from each of four food groups (milk, meat, bread, fruits and 
vegetables) [63]. 


Only two reports were found documenting the use of a manual method 
of scoring a food frequency questionnaire, namely those of Strohmeyer 
et al. [64] and Scrimger [65]. A report by Krebs-Smith and Clark 
described the potential (best-case) validity of a scoring method: it gave 
directions for scoring once the total number of servings per food group 
had been determined, but it did not present the method used for 
assigning the number of servings [66]. Based on 24-hour intakes from 
1,431 individuals in the 1977-78 Nationwide Food Consumption Survey 
and a food guidance system (a food wheel), the scoring system correctly 
classified 69 to 98% of persons in each population segment. Children 
were classified most accurately, followed by teenagers and pregnant and 
lactating women. Information was not provided about the accuracy of 
this method when used with food frequency questionnaires in the 
clinical setting. 


The scoring method described by Scrimger uses overlays; these make 
it possible to have the FFQ free of cues and distracting words, symbols, 
or numbers. The Scrimger method, which involved the use of a 
calculator, required a mean of 4 + 2 minutes but Scrimger made a 
number of suggestions for shortening this time through improved design 
and instructions [65]. No information was provided concerning the 
accuracy of the scoring. 


The scoring method used by Strohmeyer and colleagues was not 
described in detail [64]. It was designed for use with a questionnaire 
that asked women to report the number of times per week that nine 
types of foods were eaten and to indicate usual portion size. Scoring 
involved several steps of multiplication and addition and reportedly 
required an average of 2 minutes. There was no indication that the 
accuracy of the scoring was verified. These investigators used an 
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artificial method* to determine how well the scoring method could 
produce results comparable to those produced by dietary analyses of sets 
of diet recalls. However, Strohmeyer et al. did not study the extent to 
which the intakes reported on the form corresponded to the same 
women’s intakes reported by other methods, such as diet recalls. 
Without such studies, the approach may be of highly uncertain validity: 
the general public has widely differing perceptions of what foods belong 
to various food groups, and the thought processes needed to estimate 
frequency of food group use are highly complex. 


"The researchers took data from sets of diet recalls, entered the numbers 
of servings and serving sizes on the form, and computed the scores. 




















Il. REVIEW OF THE STATE WIC FOOD FREQUENCY 
QUESTIONNAIRES 


A. STATE AGENCY QUESTIONNAIRES 


The FNS provided the investigators with a set of food frequency 
questionnaires, other dietary data collection instruments, and supportive 
information that State agencies had submitted to them in 1988. A total 
of 33 States (including Alaska and Hawaii), 1 territory, and 11 Indian 
nations submitted some type of food frequency questionnaire. An 
additional 12 States, 2 territories, 7 Indian nations, and the District of 
Columbia responded that they used diet recalls rather than food 
frequency questionnaires. 


The WIC FFQs were examined to gather information on the following: 
single foods (foods included, total number), food groupings” (foods 
included, total number, numbers of foods per grouping); format; 
instructions; characteristics influencing readability; scoring system (if 
provided), including categorization by food group; and comparisons 
between women’s and children’s questionnaires from the same State. 


B. FINDINGS FROM THE STATE WIC FOOD FREQUENCY 
QUESTIONNAIRES 


In the examination of the WIC FFQs, special attention was directed to 
foods included on children’s FFQs that were not included on women’s 
FFQs. Since it was impossible to determine if complete sets of all the 
versions of the FFQs had been submitted by the State agencies, a 
quantitative description of differences between women’s and children’s 
questionnaires is not appropriate. In the cases in which both a woman’s 
and a children’s questionnaire were submitted, however, there were 


“The term food grouping represents two or more foods listed together 
as a single item on a food frequency questionnaire. It differs from the 
term food group, which in this document refers to the components of a 
system for evaluating diets (i.e., the Basic Four Food Groups or some 
variation thereof). 
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generally no differences in the food items included;* in fact, coffee and 
alcoholic beverages were often listed on the children’s questionnaires. 
This finding provided support for making the food lists nearly identical 
for the WFFQ and CFFQ. 


In most cases, the WIC FFQs and supporting materials provided 
relatively little specific information related to scoring procedures. In 
the review attention was focused on instructions for scoring, design 
features that gave some clues concerning the scoring method, the order 
of presentation of food items and groups, and the food groups 
themselves. 


Twenty-three of the questionnaires did not include and were not 
accompanied by information about a scoring method. Those that 
indicated a method used some variation of a food group approach, 
examples of which follow: 


@ "Compare number of servings per day to minimum specified." 
(Certification might require inadequate amounts of at least one of the 
major food groups or of one or more of the targeted nutrients). 


@ "Adjustments may be made in number of servings needed to reach 
minimum for grains if fortified cereal is eaten." (This implies that it 
is less likely that a woman will be eligible for WIC based on nutrient 
inadequacy if she reports eating a WIC cereal). 


@ "If the intake of a food group is inadequate, make a plus sign and 
write the number of additional servings needed to meet the 
recommendation." 


@ "Evaluation by food servings, based on status." (This implies that 
pregnant and lactating women can be certified with higher intakes 


than can postpartum women who are not breastfeeding). 


@ "When any group has less than its needed points, counsel to improve 
diet." (Information about the point system was not included). 


‘Different portion sizes were used for the women and children. 











Design Features 


Determination of the 
Number of Foods 


Per Food Group 


Order of Presentation 


@ "Items checked outside of heavy black lines are inadequate." (The 
form to be completed by the client was marked with heavy black 
lines that were obviously for scoring purposes). 


On FFQs, design features that provide information or clues about the 
scoring method include the scoring directions themselves; information 
about the recommended number of servings, identification of key 
nutrients; and the use of lines, headings, spacing, or a combination of 
these to highlight food groups. Eleven of the WIC FFQs included 
explicit directions for scoring, and three more stated the recommended 
number of servings from each food group. Seven identified key sources 
of nutrients. Twenty-five used lines or spacing to highlight food 
groups, and several used headings for this purpose. 


Although these design features were obviously intended to facilitate 
scoring by the provider, most of them present the client who is a poor 
reader with a more difficult task. On the other hand, the explicit 
directions and the listing of the recommended number of servings give 
the client who is a good reader information that might influence her 
responses. (This could potentially place those disadvantaged by limited 
literacy at an even greater disadvantage than their more literate 
counterparts. ) 


Explicit methods for determining the number of servings per food group 
were seldom provided. When they were, (1) they involved a series of 
arithmetic processes, or (2) they relied on the respondent’s ability to 
report the frequency with which a group of foods was eaten. The first 
method generally involved a rather short list of foods. This simplifies 
the arithmetic and increases the chance that important nutrient sources 
will be overlooked. The second method is highly questionable because 
it involves highly complex thought processes. It is notable that the 
number of food items listed on the WIC FFQs ranged from 15 to 142 
with a median of 54.5. However, respondents were asked to report 
their intake by some kind of sizable food grouping (e.g., breads and 
cereals) rather than by individual food items; the number of groups or 
items ranged from 7 to 87 with a median of 18.5. 


If an instrument is being used mainly for screening purposes, the order 


of presentation of items can be very useful in reducing the time required 
to identify those people who have a characteristic that places them at 
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risk. By inquiring about the most prevalent conditions first, one can 
minimize the amount of time required to identify those at risk. 


Many studies have indicated that eating patterns in the United States 
often include lower than recommended numbers of servings from the 
milk group or the fruit and vegetable groups (or both) [67-69]. Thus, 
placing foods from these groups first would allow quick identification 
of most women or children with dietary shortfalls. Moreover, foods at 
the beginning of a FFQ might receive more careful attention than those 
at the end, when some women may begin to tire. 


On the WIC FFQs, there was much variation in the order of 
presentation of foods and food groups, but animal foods were often 
listed first. In some cases, decisions about arrangements appeared to 
be based on space. More often, it appeared that the order of 
presentation was completely arbitrary. The order in which the food 
groups are discussed here reflects the order in which they are 
considered in the FFQs developed for this project. This order facilitates 
quick identification of women or children who have less than desirable 
intake from one or more food groups. 


In most of the WIC FFQs, foods were arranged according to four or 
more named food groups. A few used the term "Calcium" to cover 
milk products; either the term "Protein" or "Iron" to cover flesh foods, 
eggs, and legumes; and the terms "Vitamin A", "Vitamin C", and 
(rarely) "Folacin" to cover various plant foods. 


Milk Group. WIC FFQs were in general agreement about the foods 
they included in the milk group, with the following exceptions: 
approximately half the WIC FFQs included cottage cheese, the 
remainder did not; three included cream soup. When cottage cheese 
was included, the portion size that was specified typically ranged 
between 1% to 2 cups (301 to 452 grams)--much larger than the median 
portion sizes reported by Pao et al. for 19- to 34-year old women (113 
grams) and young children (57 to 85 grams, depending on age). 


Fruit and Vegetable Groups. There were many variations on the fruit 
and vegetable groups. The most common version appeared to be 
formation of three separate groups: fruits and vegetables rich in vitamin 
C, those rich in vitamin A, and others. A few WIC FFQs made overt 








provision for considering the total contributions of foods that are rich 
in both vitamins (for example, cantaloupe could be counted both as a 
source both of vitamins A and C). Some FFQs appeared to be 
attempting to separate out rich sources of folate. 


In several cases, foods were listed inappropriately as rich sources of 
nutrients. Appropriate listings of rich sources of vitamin A include dark 
green leafy vegetables, such as spinach and turnip greens -- which 
provide approximately 700 retinol equivalents (RE) of vitamin A per 1/2 
cup serving, and carrots -- which provide approximately 1,900 RE per 
1/2 cup. Inappropriate examples include peaches (29 RE for 1/2 cup 
canned or 47 RE for one whole fresh), prunes (84 RE for 5 dried 
prunes), broccoli (110 RE for a 1/2 cup serving) and tomatoes (139 RE 
for 1 raw tomato’). In some cases, the heading used for a food 
category seemed to be inappropriate: "Vitamin C Fruits" included 
coleslaw in one, green pepper in another; "Dark green leafy vegetables" 
(probably intended to identify rich sources of vitamin A) included 
cantaloupe and mango in one, Brussels sprouts (56 RE of vitamin A per 
1/2 cup serving) in another. Some WIC FFQs distinguished fruits from 
vegetables without focusing on the nutrients they provide; that is also 
the way that foods are grouped in the USDA/DHHS publication Dietary 
Guidelines for Americans [1]. 


Protein (Meat) Group. A majority of the WIC FFQs grouped flesh 
foods (meat, fish, poultry, organs) eggs, dried peas and beans, and nuts 
(especially peanut butter) in the meat group. Variations include 
distinguishing between high and low iron "meats", distinguishing 
between animal and vegetable proteins, distinguishing high-fat meat 
from others, and including either cottage cheese or all cheese in the 
meat group (rather than in the milk group). 


Bread and Cereal Group. In general, all WIC FFQs included the 
same foods in the bread and cereal group and did not subdivide on the 
basis of nutrient content. There are two types of exceptions: (1) three 


*Twice the median portion size reported by Pao et al [70] for young 
women. Broccoli and tomatoes were very commonly grouped with 
foods much higher in vitamin A value. 
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or more FFQs included starchy vegetables in this group, (2) scoring 
methods for two or more FFQs allowed extra points for fortified cereal. 


Additional Food Groups. Other food groups found on some forms had 
various names, but the foods appeared to be grouped according to the 
following characteristics: 


High in sugar 

High in fat 

High in sodium 

High in either sugar or fat 

High in sugar, salt, or fat, or any combination of these 
Beverages 

Miscellaneous 

Combination foods 


Foods included in these groups did not appear to be counted in the 
scoring for nutrient intake. Among the potentially good sources of 
essential nutrients listed in such groups were cocoa, pizza, french fries, 
soup, macaroni and cheese, and other convenience or fast foods. 


Only 4 (8 percent) of the 50 WIC FFQs that were submitted showed no 
clear division of foods by food group. 


Other Comments. The scoring methods that accompanied the WIC 
FFQs provided no evidence that the vitamin A contributions from 
animal sources were included in the vitamin A score. The vitamin A 
contributions of milk products, eggs, butter or margarine, and liver are 
potentially great; indeed, the WIC food packages for women and 
children provide substantial amounts of vitamin A through some of these 
foods. 


The food group subdivisions used sometimes led to potential problems. 
For example, a few WIC FFQs listed the same food in more than one 
place (e.g., broccoli was listed under both vitamin C and vitamin A). 
No studies have been found to give an indication of the potential effects 
of such a practice on the responses made on a self-administered 
questionnaire. 


Many of the WIC FFQs or the scoring instructions that accompanied 











them implied that there should be an adjustment for portion size. The 
designated equivalents were not standard across the questionnaires. 
Examples of equivalents from the milk group included the following: 
1 cup milk = 2 ounces hard cheese = 2 cups cottage cheese = 2 cups 
ice cream. Examples from the meat group include these: 2 ounces 
meat = 4 tablespoons peanut butter = 4 slices bologna = 1 cup cooked 
dried beans. Making this kind of adjustment based on equivalents can 
greatly complicate the scoring process. 
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IV. DEVELOPMENT OF THE FOOD FREQUENCY 
QUESTIONNAIRE FOR WOMEN 


A. REVIEW OF DATA FROM PFFQ 


The validation study conducted by Suitor et al. provided data that were 
used to identify ways to improve the original Harvard prenatal food 
frequency questionnaire (PFFQ) [71]. In particular, the completed 
PFFQs were examined for patterns of responses and _ contributions of 
specific foods to total nutrient intakes. Also the diet recalls obtained in 
that study were examined to determine the types of foods reported. The 
format of the questionnaire, instructions, and food list were critically 
reviewed. The questionnaire used in the validation study is in appendix 
A. 


In the study by Suitor et al., the validity of the PFFQ was examined by 
comparing nutrient intakes estimated from the PFFQ with those 
estimated from sets of three diet recalls. After adjusting for 
measurement error caused by the relatively small number of diet recalls, 
the validity of the usable PFFQs was found to be acceptable for energy, 
protein, calcium, zinc, iron, vitamin C, and vitamin B-6. It was 
unacceptable for vitamin A. No other nutrients were studied. 


It was found that approximately 18% of the questionnaires were suspect 
because of unreasonably high estimates of average daily energy intake 
(>4,500 kilocalories/day) [3]. Inspection of those questionnaires 
revealed that many of the women had checked frequencies of 4-5 
times/day or 6+ times/day for foods for which such frequencies would 
seem unreasonable (as for example a reported frequency of 6+ times 
per day for ground beef). This suggests that some women had difficulty 
in understanding how to complete the questionnaire. The most efficient 
way to handle such questionnaires is to identify them by visual 
inspection, to assume that they are not accurate enough to warrant 
scoring, and to use other methods to determine if the women who 
completed those questionnaires are at risk of nutrient inadequacies. 


The method used in the Suitor study for handling doubly marked or 
unmarked items is the method proposed in the general instructions for 
scoring the CFFQ and the WFFQ (see appendix B). 


Review of diet recalls from the Suitor study indicated that macaroni and 
cheese and spaghetti and sauce were often eaten, but other kinds of 
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pasta were not. After obtaining similar information from the more 
representative information presented by Pao [70] and by Block and 
colleagues, it was determined that substituting those two pasta products 
for "spaghetti, macaroni, and other types of pasta" and "tomato sauce" 
would be more informative [18]. 


Review of the diet recalls also suggested that several foods that are very 
rich sources of vitamin A contributed to the lack of correspondence 
between estimates of vitamin A intake obtained from the PFFQs and the 
diet recalls. For example, a number of the women reported eating liver 
once per week or one to three times per month, but this food was 
named in only two of more than 320 diet recalls. From the data 
available, it could not be determined if this represented over reporting 
of liver intake on the PFFQ or underestimates of liver use relating to 
obtaining only three diet recalls per person. Use of carrots and spinach 
was also reported to be more frequent on the PFFQ than was indicated 
by the diet recalls. 


Based on the review of data, the food list was simplified by deleting 
some food items and descriptive terms such as "any kind" for milk and 
"plain or flavored" for yogurt. Some food items were combined; for 
instance, the three items "tomato, vegetable or minestrone soup", 
"cream soup or chowder made with milk" and "all other kinds of soup" 
was changed to two items "vegetable soup" and "other soup". The 
correlation coefficient of "pancakes" with "syrup" was .83, therefore, 
the two items were combined and the nutrients of syrup were added to 
pancakes. Some items were deleted from the list including "asparagus", 
"mixed vegetables" and "beer, wine or liquor". 


Initially, several items (e.g. candy, pudding, jello) were dropped from 
the WFFQ because their inclusion was not warranted by either 
frequency of use data or by nutrient content, but they were added back 
later because of their importance to the CFFQ. 


Field observations of the PFFQ suggested that portion size information 
was not used by most women and served mainly to increase the time 
they required to complete the questionnaire. For scoring purposes, 
however, portion sizes must be assumed. The portion size used in 
PFFQ gave satisfactory results in the validation study with pregnant 
women. These portion sizes represent, in most cases, the median 























Format 


weight of portions reported by women aged 19 to 29 years in the second 
National Health and Nutrition Examination Survey (NHANES I), as 
reported by Block, and should therefore be suitable for non-lactating 
postpartum women [73]. No studies have been found that report on 
change in usual portion size during lactation. 


The format of the questionnaire was revised to include the date of birth 
physiologic status of the woman, and expected date of confinement 
(EDC) if pregnant. The date of birth is useful for identification of a 
client when more than one woman has the same name. It is also used 
to calculate age in the computerized analysis of the questionnaire. The 
EDC was added at the request of WIC providers. 


B. FINDINGS FROM THE CSFII DATA ON LOW-INCOME 
WOMEN 


The 100 foods most frequently reported to be eaten by the low-income 
women in the 1985 CSFII are shown in table 1. For a description of 
the methodology used to identify these foods see page 33. These foods 
are ranked by percent of women reporting at least one use of each food 
type. This list confirms the suitability of most of the foods included in 
the PFFQ. No important nutrient source among the top 100 foods is 
missing from the PFFQ. Most items appearing among the top-ranked 
foods that were not included on the PFFQ are foods with little nutritive 
value (e.g., condiments, gravy, and non dairy creamer) or mixed dishes 
for which no widely-used name applies. Most of the components of the 
mixed dishes (e.g., potatoes, carrots, dried beans, hamburger) are 
included in the food list of WFFQ. The CSFII data were used to 
determine if additional foods could be deleted from the PFFQ without 
seriously compromising its validity. 


For each food category it is possible to identify the form of the food 
most commonly reported. This information confirmed the choice of 
foods used in the PFFQ. For example, the data show that whole milk, 
fried eggs, American cheese, white bread, fried chicken (dark meat), 
and raw tomatoes are the most common food choices; these were the 
forms of foods used in setting up the nutrient data base for the PFFQ. 
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TABLE 1 


100 MOST COMMON FOODS CONSUMED BY WOMEN 
CSFII 1985 ONE-DAY DATA 


GROUP FOOD4* 


il 9241 
io a Ws Is Re 
3 5110 
4 9210 
5 8110 
6 9110 
ou 3170 
8 9230 
9 SLE 
10 8310 
ala 6121 
12 7140 
13 5620 
14 2522 
15 1441 
16 9254 
iy 7440 
18 7550 
19 5215 
20 7410 
21 5120 
PNP) 7520 
23 2150 
24 7521 
25 2260 
26 7120 
27 5810 
28 9211 
Pe Ba 5440 
30 7150 
31 7110 
32 2751 
33 3210 
34 2523 
35 7522 
36 6310 
37 5620 
38 8311 
39 2110 
40 9140 
41 2850 
42 5220 
43 1221 
44 7514 
45 9310 
46 9130 
47 2210 
48 2521 
49 5221 
50 1410 


TOTAL’ 

1142 54. 
990 47 
987 47 
754 36 
728 35. 
706 34. 
488 23 
472 22 
434 20. 
340 16. 
326 15. 
323 15. 
307 LAS 
297 14. 
294 140 
276 13. 
261 13 
250 a2 
245 LT 
237 11 
pig) 10. 
209 10° 
202 
199 
195 
191 
186 
175 
170 
169 
168 
160 
154 
151 
151 
148 
145 
144 
143 
140 
134 
132 
130 
1:22 
120 
119 
118 
116 
115 
114 


UUMAITDDOWWPIOWOPRPWWRIPEPNPUONP HIP PHP WDWOKDWHEPWAUTHPUWOIUOOWUDADW 


UMUMUMUMUUARHARHAIIIIIIOMDDADADDWWW 


PERCENT FOODNAME 


soft drinks 

milk 

white bread 

regular coffee 
Margarine, butter 
*sugar 

whole eggs 

tea 

lettuce, cucumber, onions 
mayonnaise, salad dressing 
orange juice 

white potato 

rice 

bologna, sausage 
processed cheese 
fruit-flavored drinks 
*tomato catsup 
*mustard, pickles 
rolls 

tomatoes 

whole wheat bread 


ground beef 
corn 
bacon 
potato chips 


decaffeinated coffee 
salty snacks 
mashed white potato 


hamburger, cheeseburger 
egg omelet, scrambled egg 
luncheon meat 

peas 

apples 

cooked cereals, grits 


beef steak 
*jellies, jam 
gravy 
cornbread 
cream substitute 
lettuce salad 
beer 

honey, syrup 
pork chop 
frankfurter 
tortillas 


“First four digits of the seven digit code to identify foods. 


‘The number of the women who chose a food in that group at least once. 


There are 2079 individuals. PERCENT = ( TOTAL / 2079 ) * 100. 


*Not included on WFFQ. 
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beans, string, asparagus, beets 


pizza, taco, enchilada, burrito 


boiled or baked white potato 


Mayonnaise-type salad dressing 


cheese, cheddar or American type 








TABLE 1 


100 MOST COMMON FOODS CONSUMED BY WOMEN (continued) 
CSFII 1985 ONE-DAY DATA 


GROUP FOOD4* 
Syl 5814 
oy ESL 
SyE) 5320 
54 5210 
SS 5310 
56 2412 
57 4220 
58 2231 
59 4110 
60 $251 
61 aga ta 
62 6310 
63 7160 
64 13 1.0 
65 9120 
66 2413 
67 5813 
68 2416 
69 2140 
70 SEIS 
al 5432 
re: 6111 
de) B70 
74 2415 
15 4120 
76 22/0 
ed 5815 
78 6410 
a9 7510 
80 5840 
81 6120 
82 2714 
83 sya bate! 
84 7220 
85 2610 
86 2414 
87 2615 
88 5713 
89 74 PAA 
90 5510 
SI 6313 
92 5323 
> fe) 4121 
94 Ssa2 
95 7514 
96 iLakwal 
of Sets 
98 S755 
39 2745 

100 7521 


TOTAL? 


114 
a3 
LO 
107 


PERCENT*® 


NNNNNNNNNNNNNNNNNNHYNHNHNNHNNWWWWWWWWPh PEP PK HPF PHPUUUUUUUY 
SORPRPRPNNNNWWKEBPBUUDDADADAIIIIDMDWINDDODODWUONNKPKHPRUUIYIPRPRPRPPwWRU 


FOODNAME 


macaroni or noodles with cheese 


ice cream 
chocolate cookies 
biscuits 
chocolate cake 
chicken breast 
peanut butter 
ham 


pinto, lima, kidney beans 


able Ghasivelie 


chili, beef with gravy or sauce 


banana 

potato salad with egg 
carrots 

sweetener 

chicken leg 


spaghetti, lasagna, ravioli 


chicken wing 
beef, roast 
doughnuts 
crackers 

orange 

candy 

chicken thigh 
baked beans 
pork, spareribs 
rice mixed dish 
apple juice 


celery, cauliflower, cabbage 


soup 


grapefruit or lemon juice 


chicken with gravy or 
muffins 

broccoli 

ees hy 

chicken drumstick 
canned tuna 

corn flakes 

beef mixed dish 
pancakes 

peaches, pears 
cookies 

stewed beans 

white or yellow cake 


sauce 


cabbage salad or coleslaw 


evaporated milk 
cooked spaghetti 
rice krispies cereal, 
tuna salad 

cooked cabbage 


"First four digits of the seven digit code to identify foods. 
‘The number of the women who chose a food in that group at least once. 


There are 2079 individuals. 


PERCENT 


(STOTAL. /a2079 W)reeeL 00 


raisin bran cereal 
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C. FIELD OBSERVATIONS OF WFFQ 


Field observations were used to gather information on the readability, 
food list, and format of the questionnaire. Since Office of Management 
and Budget (OMB) clearance was not required under this cooperative 
agreement, HSPH could not pose the same question to more than nine 
persons through the field observations. Even with this limitation, a 
great deal of valuable information was attained through the field 
observations. 


Initial contacts for the field observations were made through the 
Massachusetts State WIC director, who invited sites to participate on a 
voluntary basis. After initial drafts of the WFFQ and CFFQ were 
prepared, they were administered in three WIC sites: North Shore in 
Lynn, Uphams Corner in Boston, and Dorchester House, also in 
Boston. The racial/ethnic distributions at the three sites are presented 
in table 2. 


TABLE 2 
PERCENT DISTRIBUTION OF RACE/ETHNICITY OF 


CLIENTS 
AT THE FIELD OBSERVATION SITES 


Race/Ethnicity 


Black, not Hispanic 








Administration of the 
Women’s Food 


Frequency 
Questionnaire 


The facilities at the three sites vary greatly. The Lynn site, which is 
affiliated with the North Shore Health Center, has a modern well-lit, 
spacious building with a large, modern waiting room and private offices 
for clients to meet with the nutritionists. The Uphams Corner WIC site 
is located in a store-front on a busy inner-city street, sandwiched 
between the Food Stamp Program office and the post office, and one 
block from the affiliating health center. From the street, one enters a 
small waiting room that is separated from the office cubicles by a 
locked door. A window allows clients communication with the staff. 
The nutritionists provide services in windowless cubicles along either 
side of a central walkway. The third site is at Dorchester House, a 
multi-service center in a free-standing building where medical care, day 
care, an elderly lunch program, and other community services are 
provided. The WIC services are provided in either the large 
dining/meeting room or a classroom used for day care. The clients sign 
in and wait at tables while the WIC nutritionist and other WIC staff 
provide services at another table, all in full view. 


North Shore. As a part of routine WIC activities over a period of one 
day, the receptionist distributed the WFFQ to any prenatal or 
postpartum clients without instructions. This is the same method as the 
current WIC tool distribution. The clients fill in the tool and then meet 
with the nutritionist. 


Uphams Corner. The nutritionist recruited the women and asked them 
to sign a consent form provided by the WIC site. Then either the 
nutritionist or the investigator gave them oral instructions on how to fill 
out the WFFQ.° The investigator observed the length of time for 
completion and difficulties in filling in the form, and interviewed the 
women to gather information on readability, clarity of directions, and 
any difficulty completing the questionnaire. 


Dorchester House Site. The investigator or the nutritionist recruited 
women and asked them to sign a consent form provided by the WIC 


*The verbal instructions were very brief (less than 1 minute per woman) 
and focused on putting only one x per food item and on the range of 
choice in frequency of consumption. 
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site. After brief instructions the women filled in the questionnaires and 
provided feedback on ease or difficulty in filling out the questionnaire. 


Since the number of observations was limited to only a few individuals, 
and the WFFQ underwent minor changes after the field observations, 
the information described below should be considered to be merely an 
indication of what the findings might be in large scale testing. In no 
way should these findings be viewed as generalizable or to represent a 
sample from which inferences could be properly drawn. 


Observations were made on the following: 


When it could be determined, the amount of time used to complete 
the WFFQ ranged from 6 to 15 minutes with a mean of 12 minutes. 


Two of the women appeared to have difficulty in completing the 
form. All the women, when interviewed, said the form was easy to 
complete. With the exception of "squash" for one woman, all the 
food items were familiar to the women. None of the women could 
recall foods they ate that were not in the food list. 


The error rate for questionnaires where no difficulty was reported 
was .02 percent (no response and double marked items). 


Participating nutritionist asked for two additions to the questionnaire: 
1. Expected date of confinement (EDC), and 


2. Date of birth (for identification purposes when more than one 
woman has the same name) 


Comments from nutritionists: 
1. The listing of several food items rather than the name of a food 


group (e.g., "fruit") seems to give better information for 
assessment and education. 


2. They had difficulty in estimating nutrient intake or number of 


servings using the WFFQ because the foods were not entirely 


arranged by food group.” 


The following changes in the WFFQ were made as a result of the field 
observations: the written directions on the form were revised, EDC 
and date of birth were added, and the column headers for frequency of 
intake were repeated part way down the page where possible. 


‘The nutritionists did not have the manual scoring method for the 
WFFQ at this time. 
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V. DEVELOPMENT OF A FOOD FREQUENCY 
QUESTIONNAIRE FOR CHILDREN: 
ANALYSIS OF DATA FROM THE CONTINUING SURVEY 
OF FOOD INTAKE BY INDIVIDUALS 


A. METHODOLOGY 


As recommended by the WIC Task Force on Dietary Assessment [7] 
and by FNS, the Continuing Survey of Food Intake by Individuals 
(CSFII) was used as a reference data base. The data set selected for 
analysis was the 1985 one-day set for low-income women and their 
children [74]. The main purposes of using this data set were to obtain 
information on the foods most commonly used by young children and 
to estimate median portion sizes for foods consumed by young children. 
Of the four CSFII data sets available, the one selected contained the 
largest number of children (1,314 children aged 1 through 5 years* 
compared with 816 children in the 1986 1-day CSFI, and 571 and 306 
children in the 1985 and 1986 4-day data sets, respectively). 
Furthermore, the data set used was the only one in which all data were 
collected by face-to-face interviews. It was also possible to use the 
same data set to determine the foods most commonly consumed by 
2,079 low income women aged 19 to 50 years. 


The variables used for the project included household ID, individual ID, 
geographic region, age in years, race, date of the interview, food 
occasion (breakfast, lunch, snack, etc.), food code, food name, and the 
weight of the food in grams. Because the variable race was not 
identified for any person under age 19 years, the race of the woman in 
the household determined the assignment of race for the children. In 
the eight cases in which there was more than one woman in the 
household and more than one race, the race for the child was coded 
unknown. Information on food occasion was examined to obtain insight 
concerning the extent to which food consumption occurred outside of 
the home and thus, possibly, was not observed by the person reporting 
the child’s food intake. 


“Although the sample comprises children described as 1 to 5 years of 
age, the data tapes include data on infants (age less than 1 year of age) 
and on 5-year old children. 
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Identification of the 


Most Commonly 
Used Foods 


Identification of Median 


Of the 849 households with children, 267 included more than one child. 
Since the children in such households were likely to be eating the same 
foods, and since this might bias the estimates of food use, we randomly 
selected one child per household. The resulting sample represented 849 
children aged 1 to 6 years and included 11,088 food records. (Each 
food record represents one food from the 24-hour diet recalls.) 
Children between the ages of 5 and 6 years were then excluded because 
they are not eligible for WIC benefits. This resulted in a sample 
representing 716 children and containing 9,261 food records. 


To identify the foods most commonly consumed across the sample, it 
was necessary to delete food records for foods eaten more than once in 
the 24-hour period by the same child; for example, the child may have 
eaten bread or milk several times during the day. Thus, the foods were 
ranked on the percent of children using the food at least once that day. 
This created a subsample of 7,771 food records. 


To the extent possible, the food coding system employed by the CSFII 
was used to group similar foods. This system uses a seven-digit code 
to characterize foods quite explicitly; however, the use of only the first 
four or five digits (moving from left to right) allows useful grouping of 
most foods. For example, the four-digit code 1111 included most forms 
of milk, and the code 6121 included at least six different types of 
orange juice. 


Using the first four or five digits of the CSFII seven-digit code, a list 
of 348 groups of food used by children 1 to 5 years of age was 
compiled. This was followed by visual inspection of the data and the 
combining of food codes as necessary. For example, it was necessary 
to combine more than 52 seven-digit codes to account for all the types 
of ready-to-eat cereal. After making the necessary combinations, the 
foods ranked from one to 100 represent 191 (55 percent) of the 348 
food groupings. 


The same general procedure was used to identify the commonly 
reported foods for the low-income women in the 1985 CSFII one-day 
data set. 


To examine the portion sizes of foods reported for children, data were 


Portion Size for Children analyzed for single years of age, for age categories 1 through 2 years 
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Food Use by Children 


Portion Size 


and 3 through 4 years, and for all four years combined. 


The distribution of the data were examined by means of box plots, 
scatter plots, and other descriptive statistics using SAS [75]. 


B. FINDINGS FROM THE CSFII DATA 


The 100 foods (ranked by percent of children for whom at least one use 
of each food type was reported) eaten by the low-income children in the 
CSFII are shown in table 3. Items appearing among the top-ranked 
foods that were not included on the earlier Suitor version of the 
women’s questionnaire include catsup, popsicles, popcorn, ham as an 
entree (rather than as a sandwich meat), pickles, fruit cocktail, and 
certain mixed dishes for which no widely-used name applies. Ham had 
been pretested for inclusion on the Suitor women’s questionnaire, but 
it was deleted because it led to considerable double counting (as pork 
and as cold cuts). Some of the items (e.g., mustard and catsup) are 
consumed in such small portion sizes that they do not warrant space on 
the CFFQ. As for the women, most of the major components of the 
mixed dishes are included in the CFFQ as individual food items. 


Examination of the descriptive statistics from the CSFII data concerning 
portion size revealed the following: 


@ The gram weights recorded for a majority of the food items 
corresponded to discrete units of the food, e.g., the standard weight 
of a slice of cheese or of a 1/2 cup serving. This implies that very 
young children typically consume standard portions without leaving 
any waste or that the data collection method did not include probes 
for waste. 


@ A number of foods were eaten by so few children that median 
portion sizes were likely to be unrepresentative. 


@ Data were skewed toward high values, some of which were 
implausible (e.g., 725 grams [about 3 cups] of cooked cereal). 
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TABLE 3 


100 MOST COMMON FOODS CONSUMED BY CHILDREN AGED 1 TO 5 YEARS 
CSFII 1985 ONE-DAY DATA 


GROUP FOOD4* 
al dibabal 
cz, sable) 
3 8110 
4 9241 
5 BiL0 
6 9254 
7 6121 
8 9110 
9 7140 

10 ASAP 
ial, 5620 
ez 4220 
dS 6310 
14 7440 
5 1441 
16 9140 
wy 5620 
18 7120 
9 9230 
20 252 
ARAL 7520 
22 5440 
23 oe 
24 20 
25 5320 
26 6410 
au, 8310 
28 6310 
29 ab Sybil 
30 SiS 
31 Ses i0 
32 5813 
33 BAPAC 
34 5814 
25 yee) 
36 5810 
37 750 
38 2260 
zi) 5120 
40 5730 
41 Ysyalak 
42 2523 
43 5840 
44 7110 
45 71522 
46 7550 
47 9174 
48 2414 
49 5432 
50 Za Tisyat 


TOTAL 


716 
422 
266 
238 
220 
220 
187 
La 9 
154 
148 
134 
133 
129 
29 
AAT) 


COP PPADIBDBOPPWUPBDHIDONFRAEYUFPEPARBRONKRUDVWOOPONNIDARPOWWDOOWNW 


DADNNDNDAHDAKHHAIITIITNMN®DAAAWW VO 


PERCENT® 


FOODNAME 


milk 

white bread 

Margarine, butter 

soft drinks 

whole eggs 

fruit-flavored drinks 
orange juice 
*sugar 

white potato 

bologna, sausage 

rice 

peanut butter 

apples 
*tomato catsup 

processed cheese 
*jellies, jam 

cooked cereals, grits 
potato chips 

eect 

frankfurter 

beans, string, asparagus, beets 
salty snacks 

corn 

ground beef 

chocolate cookies 

apple juice 

mayonnaise, salad dressing 
banana 

ice cream 

rolls 

syrup, honey 

spaghetti, lasagna, ravioli 
egg omelet, scrambled egg 
macaroni or noodles with cheese 
corn flakes 

pizza, taco, enchilada, burrito 
mashed white potato 

bacon 

whole wheat bread 

kix and lucky charms cereal 
lettuce, cucumber, onions 
luncheon meat 

soup 

boiled or baked white potato 
peas 
*mustard, pickles 

hard candies, gumdrops 
chicken drumstick 

crackers 

hamburger, cheeseburger 


"First four digits of the seven digit code to identify foods. 
‘The number of the children who chose a food in that group at least once. 


‘There are 849 individuals. 


*Not included on CFFQ. 
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PERCENT 


( TOTAL / 849 ) * 100: 





TABLE 3 


100 MOST COMMON FOODS CONSUMED BY CHILDREN AGED 1 TO 5 YEARS (continued) 
CSFII 1985 ONE-DAY DATA 


GROUP FOOD4?* TOTAL? PERCENT FOODNAME 

yall 2850 49 Bq (2! *gravy 

52 2210 46 5.4 pork chop 

=e! 5221 46 5.4 tortillas 

54 9257 46 5.4 fruit drink 

aS isyubulad 44 SS 5 orange 

56 7410 44 See tomatoes 

5) 7) Say 43 Seal cheerio, cocoa puffs cereal 

58 945710 43 5.3 db candy 

59 Ziel 42 4.9 chili, beef with gravy or sauce 
60 7310 42 4.9 carrots 

61 9161 42 4.9 *popsicle 

62 ARAL aes) 41 4.8 beef steak 

63 5324 41 4.8 vanilla cookie 

64 BSako 41 4.8 pancakes 

65 5733 41 4.8 rice krispies cereal, raisin bran cereal 
66 4110 40 4.7 pinto, lima, kidney beans 

67 1410 39 4.6 cheese, cheddar or American type 
68 5220 238) 4.6 cornbread 

69 5310 39 4.6 chocolate cake 

70 1183 38 4.5 cocoa flavored beverage powder 
6 8311 38 4.5 mayonnaise-type salad dressing 
72 2413 a7 4.4 chicken leg 

73 6313 36 4.2 peaches, pears 

74 4120 AS) 4.1 baked beans 

7S 5732 34 4.0 rainbow brite cereal 

76 2416 a3 ey) chicken wing 

1) 5323 a 340 cookies 

78 5410 aS Bes) graham crackers 

ue, Pre shal 3 / ham 

80 5734 Sa 357 £rostedvflakes, ‘corn pops,cereal 
81 5210 30 eal biscuits 

82 be 52 30 245 doughnuts 

83 7160 30 Bes potato salad with egg 

84 L151 2) 3.4 chocolate milk 

85 5740 29 3.4 total cereal, trix cereal 

86 2140 26 ey ar beef, roast 

87 2714 26 opal chicken with gravy or sauce 

88 26:0 25 Pele) fish 

89 7514 25 2o9 lettuce salad 

90 5150 25 269, gelatin dessert 

91 ae a he 24 258 ice cream bar or sandwich 

a2 2412 22 226 chicken breast 

93 2 ea 22 2.6 beef mixed dish 

94 5613 vA) 226 cooked spaghetti 

95 og Keak al 28 beef stew with potatoes and vegetables 
96 2756 21 2.5 bologna sandwich, frankfurter 
S)7/ 5430 Zi 2E5 crackers 

98 4121 20 2.4 stewed beans 

99 5814 20 2.4 pasta mixed dish 
100 6411 20 2.4 grape juice 


"First four digits of the seven digit code to identify foods. 

‘The number of the children who chose a food in that group at least once. 
‘There are 849 individuals. PERCENT = ( TOTAL / 849 ) * 100. 

*Not included on CFFQ. 
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Administration of the 
Children’s Food 


Frequency Questionnaire 
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The project team concluded that the median portion sizes were strongly 
influenced by the survey methods and in some cases were unreasonably 
high. Therefore, if the data were suspect because they were based on 
a small number of children, or because the values were very large or 
both, supplementary sources of information were consulted before 
assigning gram weights to portions. These sources included the report 
Foods Commonly Used by Individuals [70] (which includes mean and 
median portions for children aged 1 to 3 and 4 to 6 years, obtained 
using data from the 1977-1978 Nationwide Food Consumption Survey), 
Patricia Guenther of USDA’s Nutrition Monitoring Division (who in a 
personal communication confirmed a tendency to overestimate the 
portion sizes of meat in the CSFII), data compiled by Gladys Block on 
median portion sizes consumed by young women (for comparative 
purposes), and tables of suggested serving sizes for children [73]. The 
portion sizes assigned to the foods (in grams) are given in table 4. 


C. FIELD OBSERVATIONS OF CFFQ 


Uphams Corner. (See site description page 28) The nutritionist or 
one of the project team gave instructions to the mothers of children aged 
15 months to 4 years; then the mothers filled in the CFFQ in the small 
waiting room. There were several children in the room and many 
distractions as persons were called to pass through the locked door to 
receive services. Two women did not complete the CFFQ because they 
were called into the WIC office; they declined to complete the form 
after their appointment. 


Dorchester House. (See site description page 29) This field 
observation was used to compare frequency response columns on the 
draft CFFQ (nine choices per item) with the same food list having a 
three-column frequency response: "not very often or never", "number 


each week", and "number each day". Each respondent was asked to 
complete the first page of each version of the CFFQ. 





TABLE 4 


FOOD PROTION SIZE IN GRAM WEIGHT ASSIGNED TO FOODS 


Food Name 


Milk 

Hot chocolate 

Cheese, plain, in sandwiches 
Yogurt 

Ice cream 

Pudding 

Orange 

Orange juice 

Apple juice 

Other fruit drinks 
Banana 

Apple or applesauce 
Grapes 

Peaches 

Strawberries 
Cantaloupe 
Watermelon 

Pineapple 

Raisins 

Corn 

Peas 

Tomatoes 

Peppers 

Carrots 

Broccoli 

Green beans 

Spinach 

Greens 

Squash, orange or winter 
French fries, fried potatoes 
Potatoes 

Sweet potatoes or yams 
Cabbage or coleslaw 
Lettuce salad 


Salad dressing or mayonnaise 


Chips (potato, corn, others) 
Nuts 

Cookies or brownies 

Cake or cupcake 

Pie (pumpkin, etc.) 


ON THE WFFQ AND CFFQ 


Portion Size 


Children 
1-2 years 3-4 years 

183 183 
28 28 
21 7A | 
117 117 
67 67 
80 120 
131 131 
124 155 
186 186 
124 155 
91 102 
106 138 
75 75 
80 80 
47 47 
68 68 
120 120 
47 47 
14 28 
42 64 
42 42 
a3 31 

9 9 
29 29 
46 46 
35 35 
27 pal 
27 a 
49 60 
42 57 
72 80 
49 60 
37 7K 
37 37 

) 12 
13 20 
15 15 
ZZ 22 
30 30 
37 37 


a") 


TABLE 4 


FOOD PROTION SIZE IN GRAM WEIGHT ASSIGNED TO FOODS 
ON THE WFFQ AND CFFQ (continued) 





Food Name ' Portion Size 
Women Children 
1-2 years 3-4 years 








Other Pie 112 66 66 
Jello 90 90 90 
Chocolate candy 32 18 27 
Other candy 15 18 18 
Tea 180 120 180 
Soft drinks 246 124 186 
Sugar-free soft drinks 246 124 186 
Baked beans or chili beans 128 83 128 
Other dried beans, peas 85 58 58 
Rice 113 87 87 
Spaghetti or other pasta 310 192 227 
Pizza 140 92 77 
Macaroni and cheese 168 121 168 
Hot dogs 44 45 45 
Hamburgers 84 58 58 
Canned tuna 28 28 28 
Cold cuts 60 49 49 
Peanut butter 16 16 16 
Bread, toast, or rolls 25 25 25 
Margarine or butter 10 5 5 
Chicken or turkey 79 62 62 
Pork chops 84 39 56 
Steak or roast beef 108 56 56 
Fish 85 48 56 
Liver 84 42 42 
Sausage 54 28 28 
Bacon 16 16 16 
Hot cereal or grits 180 154 234 
Cold breakfast cereal 28 21 30 
Donut 43 38 43 
Sweet roll or muffin 57 44 58 
Pancake 33 33 33 
English muffin or bagel 50 25 25 
Biscuit 28 19 19 
Cornbread or tortillas 56 51 56 
Vegetable soup 270 122 244 
Other soup 217 122 241 
Crackers 15 12 12 
Eggs 46 46 46 
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Findings from Field 
Observation 


The order of presenting the scoring methods was alternated. At 
Dorchester House, the observations were made in a classroom with 
tables placed in a large square. Seven women filled out the CFFQ 
while waiting for vouchers, four women declined to participate although 
they had children in the appropriate age range. The women signed a 
consent form, were given instructions for the first CFFQ, completed it, 
were given instructions for the second method, completed it, and then 
were asked to compare the two methods. 


As had been the case in the study by Suitor et al. [71] and as reported 
by Scrimger [65], the field observations made during this project 
provided evidence that some women who can read will have difficulty 
completing the questionnaire for herself or her child. For example, one 
woman could read all the names of the foods but was unable to choose 
a frequency response even with assistance. She could verbalize how 
often her child ate each food, but she could not identify the appropriate 
column for her response. 


The time required by the mothers to complete the draft version of the 
CFFQ ranged from 8 to 12 minutes. Of the 336 food items (across all 
the questionnaires’), there were seven food items with a double or a 
blank response. Four of the response errors involved a doubly marked 
food item adjacent to an unmarked food item. This problem appears to 
occur more often for food items at the bottom of the page. 


None of the women had additional food items to add to the food list, all 
of them could read each item, and one asked, "What is cold cuts?". 
The mother of a 14-month old child commented that her child ate very 
few of the foods, and two responded that their child had "natural milk" 
(meaning whole milk). 


Without hesitation, all the women said that it was easier to use the form 
where they only put an x as opposed to writing in numbers of servings. 
One woman was in a hurry and did not appear to want to fill out the 
forms; she put check marks on both the form requesting numbers and 


“The number of food items was higher during the field observations than 
that of the final version of the questionnaire. 


4] 
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the one requesting checks. Two women indicated that they needed a 
place to mark between "not very often, never" and "each week". One 
wrote in "sometimes", and the other had difficulty choosing between 
"not very often, never" and "each week". The format developed by 
Willett [76] and tested previously by Suitor et al. [71] appears to be 
much easier for the women to use then does a format that requires them 
to write in a frequency in the proper column. However, some women 
had difficulty following down a column to record a frequency response. 
To reduce the chance of making errors, it appears desirable to repeat 
the column headings mid-page. 


Workshop on Manual 
Scoring 


Challenges in Manual 
Scoring Methods 


VI. DEVELOPMENT OF A MANUAL SCORING METHOD 


A. BACKGROUND INFORMATION 


The specifications given for the questionnaire development called for 
rather quantitative results to be obtained in a relatively short time (10 
minutes or less). Not only was the questionnaire to target energy and 
the nutrients of special interest to WIC (protein, calcium, iron, vitamin 
A, and vitamin C), but the scores were to be usable for the following 
categories of WIC participants: pregnant women, lactating women, 
postpartum women, and children 1 to 5 years of age. 


On February 4, 1991, a workshop was held at Harvard School of Public 
Health to explore possibilities for realistic manual scoring methods 
applicable with the PFFQ. The workshop generated a list of possible 
approaches to scoring, resulted in the identification of logistical 
problems and constraints to be considered in developing a scoring 
method, and alerted the project team to unrealistic expectations for 
manual scoring methods. 


The discussion at and following this workshop made it obvious that 
there are many different approaches to scoring. A number of the 
methods were eliminated from consideration when FNS advised the 
project team to base the scoring method on a food group approach 
rather than a nutrient approach. 


A food group approach requires some method of estimating the number 
of servings of food consumed from each food group over a given period 
(e.g., per day or per week). Such a method must be arithmetic for a 
FFQ that asks for servings per week and servings per day. With this 
restriction in mind, the project team looked for ways to minimize the 
amount of arithmetic required. The intent was to save providers’ time 
and to reduce error. 


Based on discussions at the workshop, discussions by the project team, 
review of the literature, review of the WIC FFQs, and the guidance 
provided by FNS, the project team identified several major challenges 
related to the development of a manual scoring method. 


Limitations of the Accuracy of Shortcut Methods. Unless a computer 


is involved, shortcut methods invariably cause loss of accuracy in the 
estimation of nutrient intake. Decreasing the number of food items on 
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a FFQ decreases the chance of identifying either important nutrient 
sources in an individual’s diet or high calorie foods that may be limiting 
the intake of rich sources of nutrients. The relatively small number of 
foods included on a FFQ ordinarily must represent a diverse diet, and 
many assumptions must be made about the nutrient values of those 
foods. 


Omitting estimates of portion sizes reduces the chance of identifying 
participants whose intake is higher or lower than expected because the 
portions they consume differ markedly from the norm. The need to 
keep the scoring system quick and simple means that arithmetic needs 
to be minimized and consequently that a score or a scoring category will 
cover a fairly wide range of nutrient intakes. 


Constraints Imposed by the Format of PFFQ. The format of PFFQ 
severely limits manual scoring possibilities. Two features account for 
this: (1) frequencies are expressed in ranges, so that it is impossible to 
distinguish between two and four servings per week, for example; and 
(2) the format is not designed to facilitate tallying or computation of the 
numbers of servings per day. Although work by Scrimger [65] 
indicated that women could successfully complete FFQs with formats 
different from that of PFFQ, field observations and earlier preliminary 
work at HSPH suggest that the format of the validated PFFQ is easier 
for women to use than the others [71]. If this is the case, changing the 
format might decrease the validity of the questionnaire. 


Constraints Imposed by the Arrangement of Foods . Foods on the 
PFFQ are arranged only partially by food group. At the beginning of 
pretesting in 1987, all foods were arranged in food groups as had been 
done on the Willett questionnaire [19]. However, the pretesting led to 
rearrangement of the order of some foods to facilitate the women’s 
recall and interpretation and to reduce the possibility of double 
counting. Cases in which the sequence of foods is not food-group based 
include sandwich fillings, bread; salad, salad dressing; soup, crackers; 
and a variety of breakfast foods from the meat and grains groups 
(regardless of fat or sugar content). 


The order of the fruits and vegetables in the PFFQ is, in part, related 
to their frequency of use and in part to the need to reduce the chance of 
misinterpretation. Foods that are high in vitamins A or C are not 


necessarily in close proximity. 


Categorization of Mixed Foods. Mixed foods (especially spaghetti 
with sauce, macaroni and cheese, and pizza) are an important part of 
the U.S. diet, and these foods should be counted in two or more food 
groups. Such foods cannot be accommodated with simple scoring 
strategies; rather the judgment of the nutritionist or dietitian is needed. 


Lack of a Definition of Nutrient Inadequacy. The lack of a standard 
definition of nutrient inadequacy poses a daunting challenge for 
developing any quick and easy method of scoring diets. Flexibility 
requires the kind of detail provided by calculating total nutrient intake 
from all foods consumed, as can be achieved easily only with 
computerized methods. Moreover, there are inconsistencies in the 
application of dietary criteria for determining eligibility for the WIC 
program across nutrients as well as across States. In particular, more 
stringent requirements are placed on iron than on other nutrients. 
Having 67 percent of the RDA be the cutoff point for iron would mean 
that all pregnant women and young children could automatically become 
eligible for WIC with relatively little error, but the methods for 
estimating adequacy of iron intake are more stringent. On the other 
hand, methods for estimating calcium or vitamin C intake usually 
indicate that an individual is eligible at intakes that are much higher 
relative to the Recommended Dietary Allowances. 


Cost. Many of the proposed strategies to facilitate a lower manual 
scoring time have a higher cost than methods in current use. Such 
strategies might include color coding on questionnaires, overlays, 
differences in shading, or pressure sensitive paper. | Without 
documentation of the overall cost savings or of improved ability to 
identify individuals at nutritional risk, the implementation of some of 
these strategies may be blocked. 


Adapting the Method for Different Population Groups. If some 
percentage of the RDA were used as a standard of comparison, target 
nutrient intakes would differ among the categories of potential WIC 
participants, within the child category for vitamin A and perhaps 
vitamin C (a 5-milligram increase at age 4), and within the lactating 
group for vitamin A and perhaps vitamin C (a 5-milligram decrease 
after 6 months of lactation). 
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Based on Minimum 
Number of Servings 
By Food Group 
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Two obvious ways to deal with this challenge are to use an arithmetic 
score with different cutoff points or to use population-specific tools that 
facilitate identification of important shortfalls (above or below a certain 
level). Requiring the use of several tools would have some distinct 
disadvantages: it would require the provider to use the correct tool, and 
it would make it more difficult for State agencies to have flexibility in 
setting their own cutoff points. Using the same general scoring method 
for each of the population groups is highly desirable because it 
simplifies training, promotes ease of use, and is likely to réduce error. 


In making decisions related to meeting the above-named challenges, the 
following statement in the request for this project was considered: 
"After identifying and examining dietary assessment methodologies, the 
instrument developed by Harvard School of Public Health . . . emerged 
as the only tool that had been developed for and tested with a low- 
income group categorically eligible for the WIC Program. " Substantive 
changes in the food items, their sequence, or the format of the PFFQ 
could change its validity in unknown ways. For these reasons, 
substantive changes in the PFFQ were ruled out and scoring options 
were pursued instead. 


B. THE SCORING METHOD 


FNS advised HSPH to develop a scoring method based on a food group 
approach rather than a nutrient approach and to use the food groupings 
included in Dietary Guidelines for Americans [1]. 


After considerable systematic trial and error, (as too complex, error 
prone, and time consuming) methods were ruled out that would produce 
numerical scores having a range that is dependent on the numbers of 
servings of foods reportedly eaten (as exemplified by the scoring 
systems devised by Krebs-Smith and Clark [66] and by Scrimger [65]. 
Instead, the project team focused on developing a method that allowed 
relatively quick identification of women and children whose intake of 
foods from one or more food groups was above or below predetermined 
levels. 


It was clear to the project team that using an entirely arithmetic 
approach was impractical in the clinical setting. The procedure required 
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would be to tally the number of foods in each of the weekly and daily 
columns by food groups and use the following formula: 


mean X, + 4X, + 8X, + 20X, 
per day 28 


where the X, are the frequencies in the nine columns. 


Instead, a pattern matching approach was developed to simplify the 
scoring process. 


Pattern matching relies on knowing what combinations of column 
subtotals for each food group provide a predetermined minimum number 
of daily servings from that group. A finite number of combinations of 
the nine subtotals can result in a daily total that equals or exceeds a 
predetermined minimum. The concept underlying the pattern matching 
is as follows: 


@ The total number of daily servings from a food group is computed 
by finding the sum (subtotals) of each of the monthly, weekly, and 
daily frequencies; converting the monthly and weekly frequencies to 
daily ones; and summing the results. 


@ The patterns of subtotals shown on the scoring templates were 
derived by determining which combinations would equal or exceed 
a predetermined minimum. When doing the computations, the lower 
level in a range was used. For example, four different foods 
consumed 5-6x/week would provide at least 4 x 5 = 20 
servings/week or 20/7 = 2.8 servings/day. This exceeds the daily 
minimum of two specified for fruits, but is less than the three 
specified for vegetables. In some cases, a large proportion of 
responses in the two columns on the far left (never and 1-3 x/month) 
can make it impossible to achieve the recommended number of 
servings. 


@ By examining the patterns on the templates, one can identify when 


the minimum is exceeded, intake provides less than the minimum, or 
further pattern matching is necessary to determine eligibility. 
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® The sequence of the patterns was selected to facilitate efficient 
scoring. 


® When the number of food items in a food group and/or the specified 
minimum number of servings is large, as is the case for fruit and 
grain groups, a very large number of frequency combinations can 
result in meeting the specified minimum. Since this makes pattern 
matching time consuming and highly subject to error, the use of an 
arithmetic approach to augment the pattern matching is necessary for 
the fruit and grain groups. 


@ Decreasing the number of daily servings required to meet the 
minimum would simplify the manual scoring somewhat, but it would 
also decrease the number of people eligible for WIC based on dietary 
intake. Increasing the number of daily servings, as for grains, would 
complicate the scoring considerably. 


The project team’s initial efforts at developing the procedure included 
both helpful and confusing strategies. Originally, the color coding was 
a part of the questionnaire itself. This had the advantage of making the 
questionnaire quite attractive, and the design made it more difficult to 
recognize that some of the boxes were used for scoring purposes. In 
the search for alternatives to color (to minimize cost), various shapes 
were used in place of color. This was much less attractive and greatly 
complicated the wording of the instructions and the preparation of 
templates. The first attempts at preparing templates and instructions 
used a step-by-step approach that was more confusing, less efficient, 
and less economical of space. 


The following daily minimums were used in formulating the scoring 
system for both children and women (regardless of physiologic status). 
They are based on Dietary Guidelines for Americans, deviations and 
special considerations are explained below [1]. 





Revisions of the 


Questionnaires to 


Accommodate 
Manual Scoring 


Food Group Minimum Number of 
Servings Daily 


Milk products 2 
Fruits 72) 
Vegetables a 
Meats Zz 
Grains 6 


To minimize the amount of arithmetic required, the project team 
developed a scoring system involving color coded overlays used to 
match patterns of food frequencies (see appendix C for models of the 
templates). Because of the large number of combinations that would 
result in intake equaling or exceeding the specified minimums for 
vegetables and for grains, limited multiplication and addition are 
required for scoring these two food groups. No evidence was found 
that pattern matching has been used as a scoring method for food intake. 


Because the manual scoring method requires extra space on the 
questionnaire for scores, the project team examined the data to determine 
which foods, if any, might be deleted from the list without losing 
essential information. Three items--cottage cheese, tomato juice, and 
cream soup--were deleted; all were eaten by a very small percentage of 
women and children in CSFII and did not make substantial contributions 
to nutrient intake in the portion sizes consumed. 


To simplify scoring, a block of foods comprising mainly snacks and 
desserts was moved to the previous page. The meat and cereal groups 
were not separated because of concerns about how that might affect the 
validity of the questionnaire. To the extent that foods are arranged by 
food groups, the order of presentation in the questionnaire is as follows: 
(1) milk products, (2) fruits, (3) vegetables, (4) snack foods and 
desserts, and a combination of (5) grains and (6) meats and legumes. 
This arrangement has the following advantages: 


@ Milk products are the easiest group to score, and they are under- 


consumed by many women, especially those belonging to minority 
groups. This means that it would be possible to identify many of the 
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Assumptions Concerning 
Portion Sizes 


Correspondence With 
Servings Specified in 


Dietary Guidelines 
for Americans 
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eligible people very quickly, without scoring the entire FFQ. 


® According to a review of the literature, fruits and vegetables are 
ordinarily consumed in amounts well below the recommended levels. 
Thus, the second and third steps in the scoring process allow quick 
identification of most of the remaining people likely to be eligible. 


As was true of the original PFFQ, the WFFQ and the CFFQ do not ask 
the respondent to provide estimates of portion sizes. This greatly 
simplifies the task for the respondent and for the person scoring the 
form. When a scoring method is developed and evaluated for such a 
FFQ, some assumptions about portion size are required. The portion 
sizes that had been used for the Suitor PFFQ were retained for the 
WFFQ [71]. Where changes were made in food items, median portion 
sizes for young women from the second National Health and Nutrition 
Examination Survey were used. The portion sizes assigned on the CFFQ 
represented median portion sizes for the young children from CSFH, 
with a few exceptions. 


It is important to note that median portion sizes in many cases do not 
correspond with recommended or "standard" portion sizes. For 
example, the median portion size for fruit juice for women would be 
considered by some to be two standard servings, but the median portion 
size for cheese is small relative to the amount that is equivalent in 
calcium content to a serving of milk. 


Milk Products. The dietary guidelines recommend 2-3 servings per 
day for milk products. The median portion size for milk for women is 
270 grams; thus two servings daily would provide the equivalent of 
slightly more than two standard servings. Several milk-containing foods 
are not used in the scoring, including milk added to cereal (which the 
computer program adds automatically), ice cream, and pudding.” This 
suggests that the direction of error is toward underestimation of the 
number of standard servings of milk. 


*These foods are not ordinarily consumed in amounts that would provide 
more than 0.25 to 0.5 milk equivalents, and the project team ruled out 
the use of extra computations to take this into consideration. 














Overestimation and 
Underestimation 


Fruits. The dietary guidelines recommend 2-4 servings per day for 
fruit. Median portion sizes for fruits are generally comparable to or 
somewhat smaller than those indicated in the guidelines; they are larger 
for juices. This suggests that the direction of error is toward 
underestimation of the number of servings of fruit if juice is the primary 
form of fruit consumed. Juice drinks are not counted as fruits when 
scoring. 


Vegetables. The dietary guidelines recommend 3-5 servings per day of 
vegetables. With the exception of potatoes, median serving sizes are 
generally smaller than those indicated in the guidelines. The manual 
scoring method does not count dried peas and beans as vegetables. To 
do so easily would require major rearrangement of the foods. The 
contribution of legumes, pizza, vegetable soup, and spaghetti with sauce 
to vegetable intake would require a more time-consuming approach 
involving the nutritionist. The review of WIC FFQs suggests that these 
foods are not ordinarily considered in establishing WIC eligibility. 


Meats. The dietary guidelines recommend 2-3 servings per day of 
meats. The intakes of several foods ordinarily scored as meats are not 
scored in the manual scoring method. These foods include hot dogs, 
bologna, sausage, and peanut butter. Since the median portion sizes of 
these foods provide very low amounts of protein, iron, and other 
essential nutrients, including them could potentially lead to serious 
overestimation of intake from the meat group. 


Grains. The dietary guidelines recommends 6-11 servings per day of 
grains. The number of servings chosen for the cutoff point is 6. 
Median portions of many of the foods in the grains category provide the 
equivalent of two or more servings. This is true, for example, of pizza, 
spaghetti with sauce, rolls (often hot dog or hamburger buns) and rice. 


Despite the apparent problem with underestimation of the number of 
servings by food group suggested above for the milk and fruit groups, 
the estimation of energy and nutrient intake provided by the PFFQ 
tested by Suitor et al. were higher than those obtained from sets of three 
24-hour diet recalls [71]. In other words, there was a tendency for 
women to over-report their total intake when checking off food use on 
a questionnaire containing many food items. The mean and median 
portion sizes reported by the women completing the diet recalls were 
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similar to those used in computing the food frequency scores. The 
largest differences in estimates of median intakes from the two dietary 
methods were for vitamins A and C as shown below: 


Nutrient Diet Recall Food Frequency 
Median Median™ 

pine Sen Ne ee 

Energy, kilocalories 2125 2386 

Protein, grams 91 90 

Calcium, milligrams 1169 1247 

Iron, milligrams 13.7 14.9 

Vitamin A, international units 4769 9887 

Vitamin C, milligrams 108 160 





Data from Block et al. [35], obtained from higher socio-economical 
status subjects, indicate comparable overestimation of intake of vitamins 
A and C by food frequency questionnaires. The larger the number of 
food items on a questionnaire, the greater the chance of overestimation. 


These observations suggest that underestimation of food intake is 
unlikely to be a problem with the WFFQ and CFFQ. The use of 
relatively high levels of fruit and vegetable intake as the standards helps 
reduce the chance of inappropriate decisions about diet adequacy and 
subsequent denial of eligibility for the WIC program; it may be 
appropriate to set relatively high levels of fruit and vegetable intake as 
the cut-off point standards. 


The scoring method presented in the report does not lend itself easily 
to the use of different food group cut-off points for different physiologic 
groups (e.g., for postpartum nonbreastfeeding women compared with 
breastfeeding women). Different cut-off points would require the use 
of different sets of templates for women by physiologic status--greatly 


“Estimates using only questionnaires for which energy intake was less 
than 4,500 kcal/day. See Suitor et al. [71]. 





Methods 


Scoring Times 


complicating the scoring process. Moreover, because of the frequency 
intervals on the questionnaires, the degree of refinement in the scoring 
is severely limited (e.g., the questionnaires themselves do not allow 
discrimination between frequencies of 2 to 4 times per week or of 2 to 
3 times per day). To set different eligibility criteria for different 
physiologic status, a shortfall in only one food group might establish 
eligibility for pregnant and lactating women, while a shortfall in two or 
more food groups might be established as the criterion for postpartum, 
nonlactating women. 


C. FIELD OBSERVATIONS OF THE MANUAL SCORING 
METHOD 


Completed PFFQs from the earlier study by Suitor et al. provided data 
used in testing the scoring methods [71]. Responses on those earlier 
questionnaires were transferred to revised WFFQs and CFFQs. Nine 
questionnaires were then copied in quantity and distributed to WIC 
staff, the project team, and nutritionists participating in the scoring 
trials. 


Four different completed copies of the CFFQ and five completed copies 
of the WFFQ, the scoring templates, and written instructions for scoring 
the questionnaires were supplied to each of participants in the field 
observation of the scoring methods. Each participant was asked to 
score all the questionnaires following the instructions provided and to 
record the time required for each questionnaire on the front page. A 
brief questionnaire was used to elicit comments on the clarity and 
completeness of the general instructions for scoring, the content of the 
instructions on the templates, and their opinions on how much time it 
would take on average for staff to score the WFFQ or CFFQ given they 
were provided training and had some experience.” 


Table 5 displays the correspondence of manual scoring times by type 


“These providers did not have the advantages of a training session but 
were instructed to call the project team should they want additional 
instruction. 
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of scorer (project team versus other). The average time required for 
manual scoring was 4.6 minutes. The first questionnaire took 15 
minutes for some scorers who had the written general instructions, but 
no training. However, all of the scorers reduced the scoring time to 
less than 5 minutes after they had scored the first four questionnaires. 
All respondents estimated that less than 5 minutes would be required for 
staff to score these questionnaires if they had training and some 
experience. 


TABLE 5 


MANUAL SCORING TIME IN MINUTES BY 
PROJECT TEAM AND OTHERS 





Among the manual scorers there was 100 percent agreement on 
scoring (X or —) the milk products and fruit (67 total scoring 
efforts). There was a 4 percent error (3 out of 67) on both the 
vegetables and meats. The grains were scored in total agreement in 
only 3 of the 9 questionnaires; this lead to the discovery of an error 
on the template that was subsequently corrected. 


Vil. DEVELOPMENT OF THE COMPUTER SOFTWARE 
(WIC ENTER) 


A. BACKGROUND OF SOFTWARE PROGRAM 


The WIC ENTER program is a revision of the ENTER program 
used to analyze the paper copy version of the PFFQ. Several 
changes were made in the data base and software design to 
accommodate the two food frequency questionnaires (WFFQ and 
CFFQ) and to provide client identification information for WIC 
program use. The documentation for WIC ENTER is in appendix D. 


B. CHANGES IN DATA BASES 
The following changes have been made in the data bases: 
@ Nutrient data were extended to include folate. 


@ The nutrients for specific foods were updated based on revised 
nutrient data bases. Where the USDA Nutrient Data Base for 
Standard Reference, release 5, Microcomputer Version (the 
principal data base for the original software) did not have updated 
values or any values for the nutrients included (such that other 
sources of nutrient data were required), nutrient data from the 
USDA Dietary Analysis Program or from the revised Handbook 
No. 8 was substituted. 


These entries were corrected for portion size. Nearly all data 
handling has been accomplished via computer transfer and 
computations (with the exception of the last step, which required 
special formatting for the C language program). Thus, the 
chance of transcription errors has been minimized. 


@ A new nutrient data base was created using the above nutrient 
data sources and the portion sizes established for children in two 
age groups. 


@ Recommended Dietary Allowances were updated to the 1989 
values for women and for children 1 through 4 years of age. The 
categories of the RDA are as follows: 


a 


56 


Women’s RDA Children’s RDA 





Females 11-14 years Children 1-3 years 


15-18 years 4-6 years 
19-24 years —— 
25-50 years 
51+ years 

Pregnant 


Lactating 1st 6 months 
2nd 6 months 





© Food items and the corresponding nutrient data were deleted to 
match the new questionnaires. 


© The order of food items was changed to accommodate the manual 
scoring methods. 


© The vitamin A unit of analysis was changed from IU to RE. 


C. IMPROVEMENTS IN SOFTWARE DESIGN AND 
ANALYSIS 


The following improvements were made in the software design and 
analysis program: 


@ Provisions were made to execute the women’s ard children’s 
programs separately or from the same program with a menu to 
select the appropriate data base. A disk operating system batch 
file is used to provide an easy way to access either of the 
programs. This design makes revising the programs much easier. 


@ The first screen display shows the program’s name, WIC 
ENTER, in large letters and moving graphics to attract the user’s 
attention. The screen display also serves as the top menu to let 
users access the women’s program or child’s program or to quit 
easily by hitting the Y or N key to answer corresponding 


questions. 


The second screen display shows a brief introduction to the 
corresponding program about source data, data file created by the 
program, available analyses and so on. 


The program provides some concise introductions to command 
keys and the coding method employed in the program. 


New fields, including date of birth (DOB) for both women and 
children and physiologic status and expected date of confinement 
(EDC) for women, were added into the data files. The 
information contained in these fields is used by the program to 
refer to the correct RDA. In order to simplify data entry, the 
program prompts the user to enter EDC only if the physical 
status of a woman is pregnant. 


All entered dates are checked for logical errors including 
unreasonable date, date of birth (DOB) greater than date of 
session and EDC less than date of session. Age is calculated by 
the program and checked against the designated age range, which 
is 11 years or over for pregnant women and 1 through 4 years 
for children. If the program detects any foregoing error it 
displays an informative error message and prompts the user to re- 
enter a date. 


The program was expanded so the analysis of the nutrient data 
could be displayed on the screen as well as printed. Analyses 
include the mean servings per day for nine food groups, the 
number of food items selected, the number of items double 
marked and without any mark, a bar graph of the INQ for eight 
nutrients, and an estimate of total calories per day (as shown 
below). In addition, it produces a list of the number of servings 
reported for each food item. 


oy! 


MEAN SERVINGS PER DAY BY FOOD GROUP 


Food Group Servings per day 
Milk products 2i53 
Fruits (0).5 
Vegetables 8) a) 
Breads and cereals 28 
Meats and dried peas and beans 1.9 
Vitamin A-rich food 0.4 
Vitamin C-rich food Onm2 
Sweets PoE) 
Fats 73 2 


Items selected 57 
Items without response 1 
Items with multiple checks 1 


NUTRIENT DENSITY COMPARED TO STANDARD 1 (RDA) 


Recommended 





Protein Calcium Iron Zins Vite As eVitB6 Vitec Folate 
241% 55% 77% 50% 92% 74% iis 275% 


Total estimated calories 1372 


Field Observations of Some of the same nutritionists who used the manual scoring method 

WIC ENTER were provided a copy of WIC ENTER, instructions for its use, and 
templates to aid in data entry. They were asked to use the program 
WIC ENTER for scoring each of the questionnaires and to record 
the time required. 


The project team members independently scored the questionnaires 
using both methods. The correct score is the score obtained when 
procedures are followed correctly (without errors of addition, or--in 
the case of the computer-generated score--of transcription). 


Data entry using WIC ENTER takes a mean time of 4.5 minutes for 
persons with limited computer skills. Even with the very limited 
observations made for this report most individuals could enter a 
questionnaire in 4 minutes after having entered data from five 
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questionnaires. 


Plastic templates assist in assigning the correct code for frequencies 
when entering data using WIC ENTER (see appendix D for a paper 
copy of templates). The program allows for correction of errors; it 
is not known how many corrections individuals made, but at 
completion of a total of 45 questionnaires by five persons, less than 
1 percent of the food items had transcription errors. Comparing the 
manually scored and WIC ENTER scored food groups on the same 
nine questionnaires showed agreement in all the food groups except 
meat. WIC ENTER estimated the number of servings to be greater 
than estimated by manual scoring. The manual scoring method is 
likely to underestimate as all of the foods are not included in 
scoring. 


Using data from a previous study, 25 WFFQ’s were scored with the 
manual scoring method and with WIC ENTER. The two scoring 
methods showed agreement in all the food groups on all the 
questionnaires with two exceptions. On one questionnaire the meat 
group scored minus (—) using the manual scoring method although 
WIC ENTER indicated 2.0 servings. The manual scoring method 
would underestimate compared to WIC ENTER as fewer foods are 
included in the scoring. On another questionnaire the manual scoring 
method provided a minus (—) whereas WIC Enter indicated 2.9 
servings. The difference was due to a reported frequency of 12 
eggs per week; this amount has less influence on total servings in 
the manual scoring method. 


In order to allow the reader an opportunity to see the same 


questionnaire scored manually and with WIC ENTER included in 
appendix E are a WFFQ and a CFFQ scored by the two methods. 
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Advantages of the 
Questionnaires 


VI. FINAL RESULTS AND CONCLUSIONS 


A. THE FOOD FREQUENCY QUESTIONNAIRES 


Two nearly identical food frequency questionnaires have been 
developed for low-income women and children ages 1 to 5 years. 


The FFQs developed as a part of this project have a number of 
advantages, as listed below: 


®@ Food frequency questionnaires more accurately reflect individual 
dietary patterns with less personnel and time expenditures than do 
other methods of measurement. 


@ The WFFQ is based on a self-administered instrument that had 
undergone validation studies using a sample of low-income 
pregnant women, many of whom were WIC participants or 
eligible for WIC [3]. A copy of the validated Harvard 
questionnaire (PFFQ) is submitted with this report to facilitate 
identification of the changes made (appendix A). The 
questionnaire had since undergone several modifications for 
improved readability [77]. 


@ The food items on both the CFFQ and WFFQ represent foods 
commonly reported by participants in national surveys. 


@ The food lists are identical for the WFFQ and the CFFQ with 
minor exceptions (e.g., "tea", "orange" and "raisins" on the 
CFFQ are "coffee or tea", "orange or grapefruit" and "raisins or 


prunes" on the WFFQ). 


@ No knowledge of food grouping systems or nutrient content is 
required to complete the questionnaires. 


@ The number of foods is sufficiently high to provide a sound basis 
for nutrition education activities; thus, the questionnaires can 


serve the dual roles of screening and education. 


@ There is minimal overlap of food items, thus reducing the 
possibility of double counting. 


@ The amount of reading required is kept to a minimum. 
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@ Standard conventions are used for capitalization, rather than 
using all upper case letters. 


® Phonetic spellings are used for potentially difficult words (€.g., 
baloney rather than bologna). 


@ Simple names are listed before more difficult ones on a line 
(e.g., salad dressing or mayonnaise, rather than the reverse). 


@ The design is attractive; strategies used to facilitate 9manual 
scoring do not make the form look more complicated. 
Furthermore, the arrangement of the questionnaire promotes ease 
of response. 


@ For 53 of the 78 food items (rows), only one food is listed. 


© Heavier vertical lines are used to indicate when the time period 
is changing (i.e., from monthly to weekly and from weekly to 
daily). 


© Column headers are repeated where necessary to assist with 
proper alignment of responses. 


@ The respondent can mark frequency of use in a range rather than 
being required to give a precise number. The column headings 
are repeated mid-page to reduce the chance of making errors. 


@ Based on the earlier work by Suitor et al. [71] and on limited 
field observations during this project, it is estimated that a 
majority of women can complete the questionnaire independently, 
in less than 15 minutes under typical circumstances (e.g., in a 
busy WIC office or clinic). 


@ The questionnaires are objective and nonjudgmental; no clues 
suggest appropriate’ or ’inappropriate’ intake. 


The questionnaires have a number of limitations that should be 
clearly understood: 

















@ They are much less practical if they must be administered orally 


by a staff member to women who cannot read or cannot manage 
the column format for responses; the amount of staff time 
required is unlikely to be justified by the result. 


Brief (one minute) verbal instructions are needed; if one observes 
the respondent fill out the first three items, those having 
difficulty can be spotted. This conclusion is in agreement with 
the findings of Suitor et al. [71]. Recommended verbal 
instructions are provided in appendix B. 


Some women who can read at the sixth-grade level appear to be 
unable to correctly interpret what is required in completing this 
type of questionnaire or have a different sense of time resulting 
in unreasonable responses. When this problem exists, it is likely 
to cause response problems regardless of the written dietary 
measurement technique used. However, while dietary information 
gathered in this situation is unlikely to be useful for certification, 
it may be very useful for identifying which foods the woman or 
her child is willing to eat if these foods are available to the 
family. 


Based on findings from the work of Suitor et al. [71], it is 
considered unlikely that the CFFQ and WFFQ provide an 
accurate assessment of vitamin A intake. Modifications were 
made to try to reduce this problem, but it was not possible in this 
project to test their effectiveness. 


The effectiveness of FFQs as a screening instrument is affected 
by the definition of nutritional risk and the prevalence of scores 
below a specified cutoff point in the population being examined 
[71]. For iron and zinc, nearly all low-income pregnant women 
will have intakes less than 67 percent of the 1989 RDA and the 
FFQ will not be highly discriminating. 


The suitability of the FFQs for certain ethnic groups, especially 
Southeast Asians, Mexican Americans, Cuban Americans, 
American Indians, and various islanders is unknown, even with 
the adaptations suggested under "Recommendations" at the end 
of this report. 
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@ It is possible that some respondents will answer questions 
reflecting the present or immediate past versus the designated 
period of four weeks. 


® Mistakes may occur as result of placing check marks 
inaccurately; staff time will be needed to quickly check for 
completeness and duplication. 


B. MANUAL SCORING METHOD 


A manual scoring method that identifies women and children who 
have met or not met the minimum number of servings for milk 
products, fruit, vegetables, meats and grains has been developed. 
The scoring system uses four color-coded templates and pattern 
matching of frequencies. Very limited observations show that the 
scoring can be done in less than five minutes with few errors. 
Training sessions and experience are likely to reduce the time 
needed to score the questionnaire as there are several appropriate 
short cuts in this method. 


The scoring mechanism can be used to determine eligibility based 
on criteria of inadequacy of intake in one or more food groups. 
States can alter eligibility for different categories of children or 
women based on specific food groups or number of food groups 
with inadequate intake. 


C. COMPUTERIZED SCORING METHOD 


The software WIC ENTER is designed specifically for use with the 
WFFQ and CFFQ for data entry and analysis. The data entry takes 
less than five minutes and allows for screen display or printout of 
mean servings per day for nine food groups, the indexes of 
nutritional quality for eight nutrients -- that is, the estimated nutrient 
density compared with the nutrient density achieved when the RDAs 
are met at the energy level specified for the physiological group, 
mean servings per week for all eight nutrients, mean servings per 
week for each of food items on the questionnaire, codes for 
mismarked food items, and client identifier information on every 


Computerized Analysis 


Testing and Future 
Evaluation 


page. The calculated percent of the RDA achieved is not reported 
since the estimates are likely to be highly misleading with this 
method of data collection analysis. 


The main limitation of the computerized analysis is the need to enter 
the woman’s responses to the questionnaire using WIC ENTER. 
Although a person who is moderately experienced requires only 
about five minutes to enter the results from a single questionnaire, 
and a skilled person can complete the task in three minutes or less, 
this represents an extra task that requires time and introduces the 
possibility of transcription error. 


The project team considers self-administered, computerized food 
frequency questionnaires to be a much more promising approach for 
gathering dietary data from low-income women. The rationale is 
provided under conclusions. 


D. CONCLUSIONS 


The conclusions and suggestions that follow are based on 
information obtained in earlier studies, analyses of data from a large 
sampling of WIC FEFQs, field observations of the submitted 
instruments involving WIC clients and staff, literature reviews, and 
constraints imposed by manual scoring methods. 


There is a clear need for testing of questionnaire formats and of the 
recall of dietary information using subjects drawn from the 
population groups served by WIC. Smith, Jobe, and others have 
presented models for such testing [78-80], but their subjects have, 
in general, been much more socio-economically advantaged than 
those served by WIC. Information gathered through such testing 
might help identify strategies for improving the completeness and 
accuracy of recall and clarify expectations concerning the accuracy 
of recalled dietary data. 


If determined appropriate and feasible, the HSPH instruments could 


be evaluated for validity. As recommended by the WIC Task 
Force on Dietary Assessment, the HSPH instruments would be 
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validated against a standard reference, (e.g., multiple dietary 
recalls), along with another set of existing tools to compare 
performance between the two sets of tools). 


Should FNS wish to propose tests of validity of the HSPH 
instruments, careful consideration must be given to the logistic 
problems involved in collecting multiple dietary recalls over a short 
time period from low-income women as compared with women from 
more advantaged groups. In general, repeat diet recall interviews 
cannot be planned to coincide with clinic visits and must therefore 
be conducted at the participants’ homes. The use of telephone 
rather than face-to-face interviews when possible simplifies the 
process somewhat [71]. However, it should be recognized that 
Suitor achieved a 60 percent completion rate for sets of three 1-day 
diet recalls only by employing intensive efforts including: 


@ placing calls (or calling back) at times convenient to the women, 
often at night and on weekends and holidays; 


@ repeating the placement of unanswered calls at a variety of times 
for at least seven attempts (busy signals did not count as 
attempts); 


@ making home visits to women without telephones, with seven 
day-time attempts if necessary. 


All these contacts were made by Suitor, eliminating problems that 
arise when a person who has not been introduced to the subject tries 
to make a contact. Locating or reaching the woman by telephone 
often was difficult because of shared telephones, disconnected 
telephones, and language barriers with other household members; 
doing so in person was hindered by lack of apartment numbers in 
many buildings, by sudden change in residence, and by locks on 
buildings with no system for alerting the occupants other than 
shouting. In many areas it would be exceedingly difficult to recruit 
interviewers to visit women in their homes for this purpose. 


Of the 160 women randomly selected for diet recall interviews, it 
was impossible to make any contact with 20 percent of them and 
incomplete sets of diet recalls were obtained from an additional 20 


Customizing the 
Instruments for 


Specific Needs 


percent. Attempts to obtain more than three diet recalls from the 
women in that study would no doubt have resulted in further loss to 
follow up--perhaps to a very serious degree. 


The collection of diet recall data should occur in close proximity of 
time to the completion of the FFQ; otherwise, because of the rather 
high possibility that food behaviors change somewhat over the 
course of pregnancy, the intake that is reflected by the FFQ might 
be quite different from that reflected by the diet recalls. 


Customizing the FFQs to reflect local eating practices should be 
undertaken only after careful consideration of numerous practical 
matters and with a clear understanding of (1) the extent to which the 
FFQs already incorporate ethnic foods, (2) elements of food 
frequency questionnaire design, and (3) necessary changes in WIC 
ENTER. 


Assuming that the scoring method will remain the same regardless 
of the questionnaire version, the practical matter of greatest concern 
related to customized FFQs involves proliferation of different types 
of questionnaires in a given setting. In many urban areas, each 
local WIC program serves several cultural groups. Thus, clinic 
personnel might need to handle six or eight different forms rather 
than just two. There is also a problem of FFQ selection because of 
diversity within cultural groups. For example, a non-Hispanic 
woman may be associated with a Puerto Rican household and 
consume Puerto Rican foods. Some Mexican Americans eat no 
more Mexican-American foods than do their non-Hispanic 
counterparts. Suitor observed these kinds of inconsistencies 
frequently when collecting 24-hour recalls from 160 low-income 
pregnant women living in three different geographical areas of 
Massachusetts [71]. 


The questionnaires as developed make considerable provision for 
ethnic foods in two ways: by naming them, usually in combination 
with another food or foods (e.g., hot cereal or grits; baked beans, 
chili beans, or refried beans), and by including many of their 
components (e.g., other dried beans and tortillas). Nearly all the 
foods of possible nutritional importance to ethnic groups that 
appeared in the CSFII data were included in some way in the CFFQ 
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or the WFFQ.* Among the absent foods are lamb and venison 
(commonly eaten by some tribes of American Indians), fruit cobbler 
(reported by some blacks), and a few fruits and vegetables. 


The PFFQ was developed in Spanish for use in a prior study. The 
WFEFQ and CFFQ could also be developed in Spanish with very 
careful translation recognizing that the various ethnic groups use 
different words for some foods. 


The number of different kinds of fruits and vegetables eaten in the 
United States and its territories is large: in the WIC food frequency 
questionnaires submitted by state agencies to FNS, more than 42 
fruits and 64 vegetables were listed. It is unreasonable to include 
a complete list of fruits and vegetables on a food frequency 
questionnaire; such a list would increase the chance of over 
reporting, make it more difficult and time-consuming to complete 
the questionnaire (which could lead to other problems), and greatly 
increase the complexity of manually scoring the questionnaire. 


Consequently, efforts to customize the questionnaires should follow 
these guidelines, keeping changes to a minimum: 


@ If an item contains more than one food, and it is known that one 
of those foods is seldom if ever eaten by the population group 
being served, delete the extra food (e.g., for a southeastern black 
clientele, change "hot cereal or grits" to "grits", and change 
"cornbread or tortillas" to "cornbread"). 


@ If a food item is reported in a population and the desired 
substitute makes little contribution other than energy, make the 
change as desired (e.g., substitute "fried bread" for "donuts"). 


@ Have a list of supplementary items about which to question the 
client after the scoring has been completed. The fourth page of 


"Because of the way in which the CSFII data set was coded, it was 
impossible to identify foods of importance to the different groups of 
Hispanics. 


Improving the Quality 
of Food Frequency 
Questionnaires 


the questionnaire has space for the addition of these questions. 


Regardless of whether there is further testing or evaluation of the 
instruments submitted with this final report, WIC FFQs used in 
States should strive to meet certain quality standards. Table 6, 
"Check List for Dietary Data Collection Instruments", provides 
guidelines that can assist in the development of food frequency 
questionnaires. 
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TABLE 6 


CHECK LIST FOR DIETARY DATA COLLECTION 
INSTRUMENTS 


L] Does the list of food items represent foods commonly reported by the clientele, 
along with a small number of readily available foods that are very rich sources 
of some of the nutrients of interest? 


L] Is the questionnaire free of the names of food groups (e.g., WIC juice, 
vegetables) as items? (This helps eliminate guesswork by those women who 
don’t know what is included in a group or how to count multiple items.) 


CL] Is the number of foods sufficiently high that the questionnaires provide a 
sound basis for nutrition education activities? 


CL] Has overlap of food items been avoided? (This reduces the possibility of 
double counting.) 


CL) Is the amount of reading kept to a minimum? 


LC) Are standard conventions used for capitalization? (The use of all upper case 
letters makes word recognition and reading more difficult.) 


CL] Is the type sharp and clear? 
C) Is the design simple and attractive? 


L] Do the strategies used to facilitate manual scoring add to the attractiveness of 
the form rather than making it look more complicated? 


L] Is the questionnaire designed for ease of use by the client rather than by the 
health care provider? 


L] For all, or nearly all, of the items (rows), is only one food listed? (Exception: 
If the question is of the type, "Did you eat any of these foods yesterday? [Yes 
or No]", listing more than one food may be highly acceptable.) 


L] If the questionnaire asks about food use over different periods of time (e.g., 
monthly, weekly, and daily), is a method used to help the client recognize the 
shift from one to the other? Does the arrangement of responses provide for 
a consistent increase or decrease in frequency? The following example does 
not; it is an illustration of an arrangement that is not recommended. 


Per day Per week Per month 
12345 123456 0123 


L] Are strategies used to assist with proper alignment of responses? 





Planning for Expanded 


Monitoring of Specific 
Nutrients and Other 


Food Components 


Self-Administered and 


Computerized 
Questionnaires 


Recent publications [81,82], urge Americans to moderate their 
dietary intakes of fat, cholesterol, sugar, and sodium and to increase 
their intakes of food sources of fiber. Although current federal 
regulations for the WIC program do not address these nutrition 
concerns specifically, it is possible that this will change. Indeed, 
many of the food frequency questionnaires from State WIC agencies 
had special categories for foods high in fat, sugar, and sodium-- 
apparently for use in nutrition education. 


A means of monitoring intakes of fat and fatty acids, cholesterol, 
sugar, sodium, and dietary fibers in the diets of WIC participants is 
an important future consideration. Such monitoring could serve as 
a specific aid in nutritional counseling, particularly in adhering to 
Dietary Guidelines for Americans [1]. Since a number of foods in 
the WIC package (such as eggs, cheese, and whole milk) are 
relatively high in fat and cholesterol as well as being excellent 
nutrient sources, it would be important to develop clear guidance 
concerning the nutrition messages related to those foods. 


These food components are not easily monitored via manual scoring, 
but can be accommodated through the computerized WIC ENTER 
program. Expansion of the nutrient data base to accommodate any 
desired nutrient is possible. Additional questions could be posed on 
the FFQ to obtain discreet information on fat or other nutrients in 
the diet. Such information adds considerably to the personalization 
of the dietary intake information, aids in nutritional counseling, and 
is easily coded for entry into a computerized program. 


Further investigation of the feasibility of using self-administered, 
computerized questionnaires as a dietary data collection method in 
the WIC setting should be considered. The principal advantages of 
such an approach would be (1) the ability to collect and analyze 
rather detailed information and produce useful reports in a manner 
requiring minimal time and effort by the health care provider and 
(2) the simplification of the data collection process for the client. 


Efficient data gathering and reporting. Although evidence of the 
efficiency of the use of self-administered computerized FFQs has not 
yet been reported, there are several reasons to believe that 
computerized FFQs would make it possible for health care providers 


ak 


2, 


to collect data in a comparable or shorter amount of time than usual 
and to produce useful reports of data analyses in a very short period 
(e.g., less than 30 seconds, barring difficulties occasionally 
associated with running computers). 


Without the expenditure of an inordinate amount of time, no manual 
method can produce information comparable to that prepared 
automatically by the computer. A computer program can tabulate 
and summarize data on both food and nutrient intake and make 
comparisons with whatever standards are selected. Once the 
programming is completed and staff have received the little training 
required to run the program, the potential for an efficient operation 
is large. 


Simplification of the data collection process for the client. The 
level of reading and interpretation skills required for completing 
FFQs increases with the amount of information that is conveyed 
with a single answer. A response on a form that asks for the 
frequency of food use represents a complicated thought process 
involving many elements. If a paper FFQ tries to use branching to 
break the response down into its elements, the branching process 
can be quite confusing to the reader. 


A computerized, self-administered FFQ can more nearly replicate 
the process that an interviewer would use. First a simple question 
is asked, " Did you eat X in the past 4 weeks?" If the answer is 
"No", the respondent immediately is moved on to other foods. If 
her answer is "Yes", a second, relatively simple question is asked, 
such as "How often did you eat X?" followed by a short list of 
choices. A positive response to one of those choices might trigger 
another relatively simple question. However, at no time is the 
woman confronted by a form that is likely to appear complicated, 
even if well designed. 


If the software is designed to be easy to read and use, it appears that 
low-income women who have basic reading skills can respond to 
such FFQs quickly and easily [83]. Those women who do not have 
adequate reading skill can be identified through the brief self- 
training portion of the program. In contrast, people who cannot 
read can easily mask this problem when asked to complete most 








paper FFQs. 


In short, there are serious limitations to the extent that paper FFQs 
can be simplified and still provide useful information. 
Computerized questionnaires can circumvent this problem. 
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APPENDIX A 


PRENATAL FOOD FREQUENCY QUESTIONNAIRE (PFFQ) 
USED IN THE VALIDATION STUDY 
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ID 
DAL Esa hag teas, 
WHAT HAVE YOU BEEN EATING LATELY? 


DURING THE PAST 4 WEEKS, HOW OFTEN ON AVERAGE DID YOU EAT 
A SERVING OF EACH OF THE FOODS LISTED HERE? 7 





C.J.W.Suitor: 8/86 PLEASE TURN TO NEXT PAGE 


2 
HOW OFTEN ON AVERAGE DURING THE LAST 4 WEEKS? 


PLEASE MARK ONLY ONE XFOREACH FOOD © 





PLEASE TURN TO NEXT PAGE 


3 


HOW OFTEN ON AVERAGE DURING THE LAST 4 WEEKS? 


PLEASE MARK ONLY ONE XFOR EACH FOOD 


per week 





How many eggs do you usually eat each week? (oes per week 


PLEASE PUT AN X IN THE SPACE THAT TELLS HOW OFTEN YOU TOOK EACH TYPE OF PILL 
DURING THE PAST 4 WEEKS. MARK NEVERIF YOU DON'T TAKE THEM. 
Prenatal vitamins 





Never 1-3 times/week 4-6 times/week Every day Twice a day 3 times a day 
Iron pills 
Never 1-3 times/week 4-6 times/week 


Every day Twice a day 3 times a day 
Do you take any other vitamin or mineral pills? No Yes What type? 


C.J.W.Suitor: 7/86 PLEASE TURN TO NEXT PAGE 


If you take vitamin pllis or Iron, how often do you forget to take a pill? 
Never 1-3 times/week 4-6 times a week Every day 


During pregnancy, many women change the amount of food they eat from month to month. 
Has your intake changed during the past 4 weeks for any of these foods? 


late NOY RROAL 





Did you take vitamin pills or minerals before you knew you were pregnant? Yes No 
If you did, what kind were they? 


How Is your appetite? Good Fair Poor 





What kind of cold breakfast cereal do you most often use? (Name exact type)) 
How many teaspoons of sugar do youaddto your food daily (include for coffee, tea, cereal, etc) 
How often do you eat a sandwich, burger, or sub? 











Never___—sédT'-3. Ae 4-6 week 10a) More than i/day_ 
If you drink juice, how much do you usually have? (Check only one) 
Small juice glass OR Carton, can, or bottle from vending machine, or large glass 
What kind of milk do you usually drink? None ——Ss—sRegular, = 2% ~———«<SSim 
Chocolate Buttermilk. ss 
If you drink milk, how much do you usually have? (Check only one) 


Small (juice) glass 





When you have meat, fish or poultry as a main dish, how much do you usually have? (Check only one) 











Small Medium Large 
How often did you have any of these discomforts of pregnancy In the past two weeks? 
Nausea (morning sickness) Never __—=—‘'1-3._ times 4-7 times___—~=~=—=—S— More than 7 times 
Vomiting Never__—S—s‘'1-3:_ times 4-7 times. == More than 7 times 
Heartburn Never —s—“(<éséd-3: ‘timees—————itsé4-7_ times More than 7 times 
Constipation Never__—s—sé«és1-3: ‘times. ——(is«éd4-7‘times§=—S—S*S< re than 7 times 


THANK YOU VERY MUCH FOR COMPLETING THIS FORM! 


OR Medium glass or small (8 oz) carton OR Large (12 0z) glass 


93 


94 
95 
96 
97 
98 


109 
110 
111 


APPENDIX B 


WFFQ AND CFFQ WITH RECOMMENDED VERBAL INSTRUCTION 
FOR ADMINISTERING THE QUESTIONNAIRES 
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Name 











Women’s Nutrition Questionnaire ID 
Date 
DOB 
What Have You Been Eating Lately ? eenant Me) 
Breastfeeding 
lst 6 months ‘eal 
During the past 4 weeks, how often did you eat Breastfeeding 
a serving of each of the foods listed here? 2nd 6 months 
Mark only one X for each food Not Breastfeeding 





Number of times 
Milk 


Hot chocolate 


Cheese, plain or in sandwiches 


Ice cream 
Pudding 
What kind of milk do you drink? 


whole [ ] lowfat] skim[ J ‘i al i lH pg 









last 4 wks | each week 
Number of times 24/5671 [23 | 45 | 6 | 
Orange or grapefruit 

Orange juice or grapefruit juice 

Apple juice 

Other fruit drinks (Hi-C, Kool-aid, grape 


iy 


SESE 
=) le 
if 


Cantaloupe 
Watermelon 


Pineapple 


Apple or applesauce [ead 


Raisins or prunes 
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Mark only one X for each food 
How often did you eat a serving of these foods during the past 4 weeks? 


$ 
& 
= 
oo 


i) 
(eX) 


last 4 wks each week 


E 
E 


Number of times 


~ 
w 
is 
on 
| 
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ho 
et 


ue 
oo 


Peas (canned, frozen, or fresh 
Tomatoes 

Peppers (green, red, hot) 
Carrots 

Broccoli 

Green beans 

Spinach 


lil 
3 
eae 
TSR ee ae 
HOS le ae 
Hisar els 


Greens (mustard, turnip, collards 


Squash, orange or winter 

French fries, fried potatoes 
Potatoes (baked, boiled, or mashed 
Sweet potatoes or yams 


w 
oO 


ww e 
1S) 
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Cabbage or coleslaw 
Lettuce salad 
Salad dressing or mayonnaise 


* 


WwW 
— 
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Lit 
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E 
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Number of tim 
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Chips (potato, corn, others 

Nuts 

Cookies or brownies 

Cake or cupcake 

Pie (pumpkin, sweet potato, or squash 


ie 
do 


Jello 


Chocolate cand 


Coffee or tea 


=f 
| 

cE | F 
ey el fel 
ee eT te Tee 
2 Ee eee 
a ne 
ele 
fe) ye 





Sugar-free soft drinks 


Copyright 1991, Harvard School of Public Health 2 


Mark only one X for each food 
How often did you eat a serving of these foods during the past 4 weeks? 


Baked beans or chili beans 
Other dried beans, peas, or Lima beans 










— 
B 
p= 
@ 
J 
ie) 
img 
i 
is) 
o 
Kr 
oO 
iY 
(a) 
9 
= 
5) 
<< 





pa 

















Spaghetti or other pasta with sauce 


bo 
Ena: 


Peanut butter 
Bread, toast, or rolls 


P 
Donut See a et oo 


D 
na 


Margarine or butter 





—_ 
w 





(Is a 
OOOOOO La. 


nai a oe i 


Copyright 1991, Harvard School of Public Health 




















Children’s Nutrition Questionnaire ID 
Date 
DOB 
What Has Your Child Been Eating Lately ? Age 
Respondent 
Mother[ |] 


During the past 4 weeks, how often did your child 
eat a serving of each of the foods listed here? 
Mark only one X for each food 


















om 
lth, 2 Se eee ered 
Hotchocolate 
Cheese, plain orin sandwiches | 
ont re 
ice, | ia ie ee 

eel 


What kind of milk do you drink? 


whole [ ] lowfat] skim[_ ] MiB Pe ic tr Poel Bers | fn | |r 



















Number of times 


oo 


a 
Cantaloupe 
‘Socs 0 Say ARR Sa 


— 
> 
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Mark only one X for each food 


How often did your child eat a serving of these foods during the past 4 weeks? 


Pare 


i! 


last 4 
Number of times 
Com 20 
Peas (canned, frozen, or fresh) 
Tomatoes 
| Peppers (green, red, hot) 
Carrots 





Broccoli 


ba 
do 


Green beans 
Spinach 


Greens (mustard, turnip, collards 
Squash, orange or winter 
French fries, fried potatoes 


Potatoes (baked, boiled, or mashed pes iain Paes 
Sweet potatoes or yams eid ee ees ald iat PA 32 
Cabbage or coleslaw (eee ee eae Sib | 33 
Lettuce salad aay ee en ee | ae ee 
Salad dressing or mayonnaise a ae | [hed Te bods [nema 35 





each week each day 

Number of times Ree Ee dal] 62-4 015-6 | 1 | 23 | 45 | 6+ | 
Chips (potato, corn, others , ee aS fea aE 36 
Nuts ed SS A ee a Fe a 
Cookies or brownies ; eas Sea) [eae eee: 
Cake or cupcake Piet (Ry Paredes] es a ee 39 
Pie (pumpkin, sweet potato, orsquash) |_| | | | fT | | [| a 
Other pie eee PaPOR Fee] a ee as 41 


Jello 








Chocolate cand 


F< ia ee 
ae a FR ae 
| Other coindhy "Hac aR Dia pis ail cal a aaa] | 
Co oe eee eee 
| Soft dvinks iii itieditl Se wiiiee ea wad sod otn| 5] 
[Sugarfree softdrinks | CT | 
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Mark only one X for each food 
How often did your child eat a serving of these foods during the past 4 weeks? 
ee PM number of tes y FON 1s [1 24] 56" 
Pizza ! 
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Cold breakfast cereal 
[Dornier eee aes 
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Recommended Verbal Instruction for Administering the 
Women’s and Children’s Food Frequency Questionnaires 


Fill in the client identification information in the upper right-hand corner. 


Provide the appropriate questionnaire, clipboard, and pen. Say to the woman: "This is 
the form we would like you to fill out. It has three sides. We want you to think about 
what you ate (or your child ate) during the last four weeks. We know you can’t 
remember exactly, but you probably have a good idea. 


"Suppose you (or your child) drank one glass of milk [point to milk] everyday [point to 
per day]. Then you put an X or a check here [point]. These columns are for foods you 
had just once, twice or three times in the last four weeks [point]." 


"We are asking about serving of food, not tastes. So if you put an X here [point to ice 
cream, 6+/day], that would say that you had eaten six or more bowls of ice cream every 
day for the past four weeks. Use this column only for foods you ate a lot of every day. 
Please make a mark in this column [never] if you did not eat the food. It helps you to 
keep your place and it helps us to know that you did not forget a food." 





Watch as the client fills out the first 3 foods to be sure she understands the instructions. 


Collect the finished form and check for errors in completion, 
i.e., pages or rows not filled in, double marked rows, 
number of eggs. 
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APPENDIX C 


GENERAL INSTRUCTION AND TEMPLATES 
FOR MANUALLY SCORING THE WFFQ AND CFFQ 


(Note: Actual templates heavy paperstock, plastic coated, 
color coded and the spaces within the dotted lines cut out) 


ie. 






1+ ee ¢ OMPDUST RAT Taser eas) 
Rage? SH OVINE VLU A a0 


airy BY merier ang gated MUMS (tuiraA syInht) va 
('@ > te) Ga) Bead nw bead MD bene tenkeon sino 


General Instructions for Manual Scoring WFFQ and CFFQ 


Quickly look at the three pages of the questionnaire to assess completeness and accuracy 
in filling out the questionnaire. 


Are there many checks (e.g., more that 6) in the two columns on the far right 
(those for 4 or more times daily)? If yes, assume that the woman had difficulty 
understanding how to complete the form. Evidence suggests that such women 
may be at high risk of inadequate dietary intake. 


Are there many checks in the two columns on the far left (those for never or 
up to three times per month)? If all but 6 to 8 marks are in those two columns, 
either the woman had difficulty understanding how to complete the form, or the 
marks are accurately reflecting inadequate dietary intake. 


Are there rows in which no check appears or in which more than one check 
appears? If yes, delay scoring until the woman can clarify the correct response 
(if possible). Alternatively, follow these rules if no more than 6 rows are 
mismarked: 


- a doubly-marked row followed by a correctly-marked row, count the first 
check only. 


- a doubly-marked row followed by a blank row, transfer the second check (the 
one on the right) down to the blank row. 


- a blank row followed by a doubly-marked row, transfer the first check (the 
one on the left) up to the blank row. 


- a blank row preceded and followed by correctly-marked rows, mark 0 under 
"Never" (the far left-hand column). 


If greater than 6 rows are mismarked the women had difficulty filling out the 
questionnaire. 


Score the food groups in order, beginning with Milk Products (Template 1). 
Carefully follow the directions on Template 1. When comparing the numbers in 
the colored boxes on the template with those on the questionnaire, look at the 
numbers from right to left (that is, compare the right-most number first). If the 
WIC criteria for eligibility have been met based on unmet minimum servings in 
one or both of these food groups, it is efficient to discontinue the scoring and 
begin nutrition counseling or education using the information provided by the 
questionnaire. 


To continue scoring,l place Template 2 on page 2 and score the Vegetables 


group, following the directions on the template. If criteria for eligibility have 
been met based on the first three food groups, consider moving directly to 
nutrition education or counseling using the information about foods provided by 
the questionnaire. 

To continue scoring, place Template 3 on page 3 and score the Meats group, 
following the directions on the template. 





To continue scoring, place Template 4 on page 3 and score the Grains group, 
following the directions on the template. Recognize that this group poses special 
problems in estimating the number of portions. For many foods (e.g., roll, 
spaghetti with sauce), a frequency of 1/day may actually represent 2 to 3 
"standard" portion sizes per day. 


BACKGROUND INFORMATION 
RELATIONSHIPS OF FOOD GROUPS AND NUTRIENT ADEQUACY 


For most nutrients, choosing the recommended number of servings from the food groups 
does not guarantee that intake will match some target level of intake, such as the Recommended 
Dietary Allowances (RDA) or 75% of the RDA. 


The tables given below give an idea of the range of intake of selected nutrients that may be 
achieved by combinations of commonly consumed foods. These estimates are calculated using 
the nutrient content for median portion sizes for women as determined in NHANES-I, with a 
few exceptions. 

Calcium 

From American cheese twice/day: 174 x 2 = 348 mg calcium 

From milk twice/day: = 322 x 2 = 644 mg calcium 

From cheese 1/day and yogurt 1/day = 301 + 174 = 475 mg calcium 

Daily foods contribute from 55 to 72 percent of calcium in the diet. 


Vitamin C Intake 


To identify pregnant and lactating women who are unlikely to consume adequate amounts 
of vitamin C', ask these questions: 


o Were oranges or orange juice used at least 5x/wk? (If yes, vitamin C intake will be 45 
to 60 mg/day from the citrus fruit alone; additional intake of most other fruits and 
vegetables will increase vitamin C intake by at least 6 mg/serving. 


o If no, was melon (cantaloupe or watermelon) or broccoli eaten at least 1/day? (If yes, 
vitamin C intake will be approximately 40 to 55 mg/day from these foods. 


If no, ask: 
o Is there a [ - ] in both the fruit and the vegetable groups? 
If no, vitamin C intake was probably at least 35 mg daily and often will be much higher. 


If yes (if there is a [ - ] in both groups, vitamin C intake from fruits and vegetables may 
be below 35 mg/day. 


1 This refers to vitamin C intake from nonfortified foods. Because of the widespread 
practice of fortifying fruit drinks and fruit-flavored drinks with vitamin C and because of the 
widespread consumption of these products, intake of vitamin C tends to be relatively high. 


Vitamin A Intake 


To identify pregnant women who are unlikely to consume adequate amounts of vitamin A, 
ask these questions: 


oO Is there an [ X ] for the milk group? 


o Was margarine or butter used at least 2x/day? 


o Were at least 4 eggs eaten per week? 


If the answer is "Yes" to all the above questions, assume that one-half of the RDA for 
vitamin A has been provided by these foods. The balance of the RDA could be provided by 
many food choices, for example: 


carrots 2x/week 

carrots, melon, spinach, and sweet potatoes each once/week 

a daily serving of melon, spinach or other greens, sweet potatoes, or winter squash 
a daily serving of salad, peas or green beans, and broccoli or tomatoes. 


(See attached table that gives the vitamin A content of foods (in decreasing order) for 
median portion sizes for women. 


If the answer is "No" to all the questions about dairy products and eggs, reaching the RDA 
for vitamin A may pose a greater challenge, for example: 


carrots at least 3x/week (~ 730 RE/day) or 

liver at least 2/month (654 RE/day) or 

10 servings/week (one to two servings/day) of vitamin A-rich vegetables (other than 
carrots), choosing from spinach, other greens, winter squash, sweet potatoes, cantaloup, 
or a food made with carrots (such as vegetable soup or stew).? (~ 700 RE/day) 


Note: if liver was eaten at least 1/month, vitamin A intake averaged a minimum of 
approximately 350 RE/day. 





> Note that broccoli, tomatoes, and peaches are relatively low in vitamin A value and that 
low fat or skim milk dairy products, such as many yogurts and hot chocolate made from a mix, 
are not ordinarily fortified like skim milk is and therefore are low in vitamin A. 


POTENTIALLY IMPORTANT NUTRIENT SOURCES FOR FAMILIES 
OF SELECTED ETHNIC BACKGROUNDS 


Those of Carribean Background 


Vitamin A: papayas, mangos 
Vitamin C: papayas 


Fruits: avocados, papayas, mangos 
Vegetables: plantains, green bananas, yautia 


Those of Mexican-American Background 


Vitamin A: cilantro 
Vitamin C: chili peppers, salsa 


Fruit: pricklypear 
Vegetables: cactus (in desert regions), cilantro, salsa 


Milk: sweetened condensed 

American Indians (varies greatly with the Indian Nation) 

Fruit: Ask about wild fruits in season, such as berries 

Vegetables: Ask about wild vegetables in season, such as fiddle heads, burdock root 

Meat: (Midwestern states) ask about lamb; game meats (such as venison). 

Southeast Asian 

Vegetables: Ask about bok choy, daikon, eggplant, sprouts, green onions (scallions), 
bittermelon, snow peas, leeks, bamboo shoots, watercress, waxgourd (Chinese preserving melon) 
Fruits: Jackfruit, lychees, longan, mango, papaya 


Meats: various organ meats, tofu, duck 


Vitamin A: Ask about bok choy, watercress, mangos, papayas 
Vitamin C: Ask about papaya, lychees, longan 


African American 
Vitamin A: Check questionnaire for greens 


Vitamin C: Check questionnaire for greens, yams 
Meat: various organ meats, including hog maw and chitterlings 
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Template to Score Women’s and Children’s Nutrition Questionnaires 
Please Follow the Directions in the Order Given 


Milk Products and Fruits 


1. Place this template on Page 1 so 
that the two shaded boxes show 
through the holes in the template. 


2. Count the checks in each column, 


and write the numbers in the boxes 
beneath each column. 


3. Using the colors above the boxes 
and the numbers in the boxes, 
compare with the following 
combinations for _a match workin 
from right to left. Once a matc 
1s found, mark the shaded box on 
the questionnaire with the symbol 
imp the, gray box (X or =) next to 
the matched combination. 


In the combinations, any number 


that crosses two or more small Ee ee > a I ae ae a Ie i 
boxes is the TOTAL of those small 
boxes. 


1 I 
| | 
I I 
4. Once you have marked the shaded | | 
box, go to the next food group.* I 1 

| | 

1 i} 


Milk Products Combinations 7 a 











N NiINI NIN 
NO Ny] 1) W]e 






* The shaded box with the mark [X] 
indicates the minimum intake has 
been met or exceeded. 

The shaded box with the mark [-] 
indicates the minimum intake has 
not been met. 
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Vegetables Page 2 


1. Place this template on Page 2 so 
that the shaded box shows through 
the hole in the template. 


2. Count the checks in each column, 
and write the numbers in the boxes 
beneath each column. 


ae Bee PLY the number in the box 
under B2 by 2. Add that result to 
the number in the box under Bl, 
and write the sum in the circle. 


4. Using the colors above the boxes, 
the numbers in the boxes, and the 
circle, compare with the following 
combinations for a match workin 
from right to left. Once a matc 
is found, mark the shaded box on 
the questionnaire with the symbol 
an the gray box (X or -) next to 
the matched combination. 


In the combinations, any number 
that crosses two or more small 
boxes is the TOTAL of those small 
boxes . 

5. Once you have marked the shaded 
box go to the next food group.* 


Vegetables Combinations 














* The shaded box with the mark [X] 
indicates the minimum intake has 
been met or exceeded. 

The shaded box with the mark [-] 
indicates the minimum intake has 
not been met. 





















































| Meats 


1. Place this tem ee ee on Page 3 so 
that the shaded box shows through 
the hole in the template. 


g@eecount the checks in each column, 
and write the numbers in the boxes 
beneath each column. 


3. Make an adjustment for a Eis 
adding 1 to the number of one spose 
as shown below: 


Number of Women Children 

eggs /wk 

1 None ca ae 

anor 3 [+1 ] [ j+1] 

4 [ j+2] [ jt+1] 

5 or more [ +1] Comat th asl 


4. Using the colors above the boxes 
and the numbers in the boxes, 
compare with the following 
co inations for a match workin 
from right to left. Once a matc 
is foun mark the shaded box on 
the questionnaire with the symbol 
in the gray box (X or -) next to 
the matched combination. 


In the combinations, any number 
that crosses two or more small 
boxes is the TOTAL of those small 
boxes . 

5. Once you have marked the shaded 
box, go to the next food group.* 


Meats Combinations 
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* The shaded box with the mark [X] 
indicates the minimum intake has 
been met or exceeded. 

The shaded box with the mark [-] 
indicates the minimum intake has 
not been met. 


Children 





Page 3-1 
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Grains Page 3-2 


1. Place this template on Page 3 so 
that the shaded box shows through 
the hole in the template. 


2. Count the checks in each column, 
and write the numbers in the boxes 
beneath each column. 


3. Using the colors above the boxes 
and the numbers in the boxes, aed a NeBhm al Rea lnm hg ei 1 
compare with the following 
combinations for a match workin 
from right to left. Once a match 
is found, mark the shaded box on 
the questionnaire with the symbol 
an the gray box (X or -) next to 
the matched combination. 


In the combinations, any number L--—--—--—--—--—--—--—-- 4 
that crosses two or more small 

boxes is the TOTAL of those small 

boxes. 


Grains Combinations 1 





4. If you have marked the shaded box, 
ee orherwise, continue the 
following steps. 


5. Multiply the numbers in the boxes 
by the numbers shown on the ; 
template, and write the results in 
the circles above the boxes. Add 
Ene values in the circles under 
the yellow, and write the sum in 
the white box. Add the values in 
the circles under the green, and 
ae the sum in the box under the 

ue. 


6. Compare the numbers in the white 
box and the box under the blue pr-—cl- oe ----- -------- 4 
with the following combinations 
for a match working from right to 
left. Once a match is found, mark 
the shaded box on the 

estionnaire with the symbol in 
the gray box (X or -) next to the 
matched combination. 


7. Once you have marked the gray box, 
stop. 


Grains Combinations 2 





| 
* The shaded box with the mark [X] ne ee eed ae ee rn i 
indicates the minimum intake has 
been met or exceeded. nee ea x2 | x5 | xl 
The shaded box with the mark [-] sake, 
indicates the minimum intake has 1 ' 1 


not been met. ee ee oe eee eet eye eto 4 Lorene 


oe € equG « na 
Tou sts paw 


a 


OmVvis) yee of a 
joes #12) a) reese , a 
ee 2) 


seamed. eclY grexda "os a 
a an? 
j ot Miwadlo) wt 
oP po ‘ 8s 
Rosen »s ove sy o 
a  « 4 Cod cots ori? a 
Twn ‘~ et3 ph 
er a.) s 
6 FONs Se | 


Si BBS 





* oat ya. | 

| ae ‘ 

72. 

? a) 

DmiAnit «© 
maf’ 


{oganrs tect ¢ 
a? Va » f 


ee ae 


@ + + -@d%é=a=<—~2e @ a | 


= 4 ofan 
cS || \ 


Pa eee Seles ae he © — os oe 


; ae 


Tie. 
or 




















APPENDIX D 


DOCUMENTATION AND TEMPLATES 
FOR SCORING WFFQ AND CFFQ WITH WIC ENTER 
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DOCUMENTATION FOR WIC ENTER 


INTRODUCTION 


The WIC ENTER application software was developed to handle coded responses to 
Women’s Nutrition Questionnaires and Children’s Nutrition Questionnaires for children aged 1 
through 4 years old. It provides a preliminary individual analysis and saves the coded responses 
and analysis for each client. There are two sets of programs and data files which are used to deal 
with Women’s Nutrition Questionnaires and Children’s Nutrition Questionnaires separately. A 
DOS batch file is used to provide an easy way to access either of the programs. The programs 
were written in the C programming language and compiled with the Borland Turbo C* compiler 
Version 2.0. Data files have the dBASE” dbf format, which is relatively simple and compact, 
and can be easily read by many MS-DOS applications for further analysis. 


ENVIRONMENT 


WIC ENTER runs on an IBM PC or compatible computer. There are no particular 
demands made on memory, display, printer, or disk configuration. The contents of WIC ENTER 
occupy approximately 170K bytes of disk space and each saved record for a client consumes 
about 240 bytes, so it can run on the computer with only a low density floppy drive. 


CONTENTS OF WIC ENTER 


The program and data files of WIC ENTER are contained on a single 3.5-inch or 5.25- 
inch floppy disk titled WIC ENTER. There are 7 files residing on the diskette. ENTERW.EXE 
and ENTERW.DBF are the program and data file for Women’s Nutrition Questionnaires, and 
ENTERC.EXE and ENTERC.DBF are the program and data file for Children’s Nutrition 
Questionnaires. WICENTER.BAT, WICENTER.DAT and BE.EXE are the components of the 
batch file. 


BACKUP 


Before doing anything else, make a backup copy of the diskette. Using the backup copy 
not only protects the original copy but also preserves the empty data files for future use. 


* Turbo C is a registered trademark of Borland International, Inc. 
™ dBASE is a registered trademark of Ashton-Tate 


1 


INSTALLING WIC ENTER 


WIC ENTER can be run on a floppy drive directly or be installed from the floppy disk 
onto a hard disk. We suggest that you create a directory named WICENTER on the hard disk. 
If you are going to install it on drive C, for example, and this floppy disk is in drive A, you 
would first enter 


MD C:\WICENTER 
And copy the files to the newly created directory by entering: 


COPY A:\*.* C:\WICENTER 


RUNNING WIC ENTER 


If you are going to run the application on a floppy drive, insert the diskette in the A (or 
B) drive. When you see the A> (or B>) prompt, type WICENTER and then hit the [Enter] Key 
to invoke the program. If you have installed the application in the directory named WICENTER 
on the drive C and are going to run it, you first enter 


CD C:\WICENTER 
Then type WICENTER and hit the [Enter] key. 

The programs for Women’s or Children’s Nutrition Questionnaires can also be executed 
separately. Type ENTERW instead of WICENTER to run the program for Women’s Nutrition 
Questionnaires, and type ENTERC to mun the program for Children’s Nutrition Questionnaires. 
MAIN FUNCTIONS OF WIC ENTER 

The main functions of WIC ENTER are as follows: 

1. Enter data on a client 

2. Retrieve data entered before 

3. Edit data entered before 

4. Display the analysis of data on the screen 

5. Print the analysis of data 


All entered data are subject to range check and logical error check. 


OUTPUT OF THE ANALYSIS 


The application employs the 1989 Recommended Dietary Allowances for age and 
physiologic status and portion sizes based mainly on medians reported by comparable populations 
in nationwide surveys for analyzing the data from the questionnaires. It generates screen displays 
and printouts that report the mean servings per day by 9 food groups, the total of selected food 
items, total estimated calories per day and a bar chart showing the client’s indexes of nutritional 
quality for the nutrients protein; calcium; iron; zinc; and vitamins A, B-6, C, and folate. The 
printouts also lists the mean servings per week reported for each food item. 


The index of nutritional quality (INQ) is computed by the following formula: 


Estimated nutrient intake / estimated energy intake 


SS  — x 100 
RDA for the nutrient / recommended energy intake 


OUTPUT DATA FILES 


Client’s ID, the session date, the date of birth, the coded responses from the 
questionnaires, the calorie total and the nutrients totals per day are recorded. If a client is a 
women, the physical status and EDC are also recorded. These data are saved in the dBASE dbf 
format files ENTERW.DBF for women’s questionnaires and ENTERC.DBF for children’s 
questionnaires and can be used for further analysis. 
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Template to Enter Data from Women’s and Children’s Nutrition Questionnaires to WIC ENTER 
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| Use -1 for no check in the row. 


_ Use -2 for more than one check in the row. 











last 4 wks | 





| Template to Enter Data from Women’s and Children’s Nutrition Questionnaires to WIC ENTER 
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Use -2 for more than one check in the row. 


_ Use -1 for no check in the row. 
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| Template to Enter Data from Women’s and Children’s Nutrition vielen to WIC ENTER 


Use -2 for more than one check in the row. 


Use -1 for no check in the row. 
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APPENDIX E 


SAME WFFQ SCORED MANUALLY AND WITH WIC ENTER 




















Name 
Women’s Nutrition Questionnaire Dee sf 
Date 6 / 2S VA a7 |= 


pop _6 fas / 6/ 




















i ? 
What Have You Been Eating Lately 7 ppesnant 7 Js 5 /a [sl 
Breastfeeding 
lst 6 months bg 
During the past 4 weeks, how often did you eat Breastfeeding 
a serving of each of the foods listed here? 2nd 6 months 
Mark only one X for each food Not Breastfeeding 





Number of times 
Milk 
Hot chocolate 
Cheese, plain or in sandwiches 


e) 





Ice cream 
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What kind of milk do you drink? 

whole [X] lowfat[ ] skim [ _] jrlol@jelelejelele}| [= 
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Number of times 
Orange or grapefruit 
Orange juice or grapefruit juice 
Apple juice 
Other fruit drinks (Hi-C, Kool-aid, grape 


Banana 
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5 |? ig 


Apple or applesauce 
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Grapes 
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Peaches 
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Pineapple 
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Raisins or prunes 
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Mark only one X for each food 


How often did you eat a serving of these foods during the past 4 weeks? 


reece |e | ee 
en Sete Ft say OUI Number of tines (ON STS) [1 | 23 | 45 | 6+ | 
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Peas (canned, frozen, or fresh ay a Sc Saas 21 
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Peppers (green, red, hot) ing [ 
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Carrots 


Broccoli are 


feo 
Greens (mustard, turnip, collards fears epee Ga eaadincl 28 
Squash, orange or winter Pub ‘ie ee ae. 29 
| French fies, fied potatoes te 8 os IG fe Po | | el ay 
Potatoes (baked, boiled, or mashed eg oa Se ala 31 
Sweet potatoes or yams pel es oe eae eee | | 32 
Cabbage or coleslaw a fed ie eo ee 33 
[ Lethice dalad (AT SS SCGg Me ero ue gT Ul ag Buel Oc RESP peal 
Salad dressing or mayonnaise iii eax ahha bo 35 
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Number of times 
Nuts 
Cookies or brownies 
Cake or cupcake 


Pie (pumpkin, sweet potato, or squash t 


Other pie 
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Mark only one X for each food 
How often did you eat a serving of these foods during the past 4 weeks? 


Hot dogs emer one Saye 
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Peanut butter 
Bread, toast, or rolls 





Chicken or turke 
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Pork chops, roast pork, or ribs 


Steak or roast beef 
0 





Bacon 





age 
Cold breakfast cereal 


Pe See as 
A 
aE Coe Seas 


Dn 
J 







BeEAbe E 
eh a | a) |v | Sof 


x 


Biscuit 
a aE a 
Fe ovis ova Bees Eh A aie 
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cD: W1B DATE: 6/25/91 AGE: 30.0 
' DOB: 6/25/61 EDC: 11/19/91 STATUS: Pregnant 


MEAN SERVINGS PER DAY BY FOOD GROUP 


Food Group Servings per day 
Milk products 0.7 
Fruits 2.4 
Vegetables 2.0 
Breads and cereals 0.5 
Meats and dried peas and beans Braet 
Vitamin A-rich food 0.8 
Vitamin C-rich food 1.6 
Sweets 79 
Fats 2.6 


Items selected 58 
Items without response 5 


NUTRIENT DENSITY COMPARED TO STANDARD 1 (RDA) 


a nape pees ---| | | | ---------- Recommended 














Protein Calcium Iron Zinc Vit A Vit B6 Vit C Folate 
220% 58% 51% 138% 284% 109% 300% 64% 


Total estimated calories 1517 
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DOB: 


Note: 


W1B DATE: 6/25/91 AGE: 30.0 
6/25/61 EDC: 11/19/91 STATUS: Pregnant 


MEAN SERVINGS PER WEEK REPORTED BY FOOD 


Milk 20 Pumpkin Pie 
Hot Chocolate 0.0 Pie 
Cheese 2.0 Jello 
Yogurt bel@) Chocolate 
Ice Cream 2.0 Candy 
Pudding 0.0 Coffee, Tea 
Orange 5.0 Soft drinks 
Orange Juice 2.0 Sugar-free drinks 
Apple Juice 1730 Baked Beans 
Juice Drink 5.0 Dried Beans 
Bananas 0.25 Rice 
Apples 1.0 Spaghetti 
Grapes 0-25 Pizza 
Peaches 2.0 Macaroni 
Strawberries aes0 Hot Dogs 
Cantaloupe 1.0 Hamburger 
Water Melon 190 Tuna 
Pineapple 2.0 Bologna 
Raisins 0.0 Peanuts 
Corn 0.0 Bread 
Peas 2.0 Butter 
Tomatoes 0.25 Chicken 
Peppers 0.25 Pork 
Carrots 22.0 Beef 
Broccoli 2.0 Fish 
Green Beans 0.25 Liver 
Spinach 0-25 Sausage 
Greens 0.25 Bacon 
Squash 0.25 Cooked Cereal 
French Fries 0.0 Cold Cereal 
Potatoes 1.0 Donut 
Yams i. O Sweet Rolls 
Cabbage 0.25 Pancakes 
Lettuce 2.0 Muffins 
Mayonnaise 5.0 Biscuits 
Potato Chips 0725 Cornbread 
Nuts 0.0 Vegetable Soup 
Cookies 1.0 Soup 
Cake 0.25 Crackers 
Eggs 


Code -2 represents multiple checks on a food. 
Code -1 represents no response. 


4tu.S. Government Printing Office : 1992 - 311-367/60213 
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